Bias-Corrected Estimators for Joint Entropy, Conditional Entropy, and Mutual Information in the Discrete Bivariate Case: Theory and an Application to Motor Insurance
This paper studies the finite-sample bias of plug-in estimators for joint entropy, conditional entropy, and mutual information for finitely supported discrete random variables. Using the univariate reduction framework developed in our companion works, we derive explicit first-order bias formulas. For a pair (X,Y) with support sizes r and s, the biases are respectively -(rs-1)/(2n), -r(s-1)/(2n), and (r-1)(s-1)/(2n). We then propose bias-corrected estimators for the three measures and prove that the uncorrected and corrected versions are asymptotically equivalent, differing by a deterministic…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2610.02558
curl -X POST /api/v1/records/arxiv/2610.02558/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.02558/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'