{"id":"arxiv/2607.27721","url":"https://arxiv.org/abs/2607.27721","tags":["math.PR","math.ST"],"score":0,"title":"Asymptotic bias of the plug-in Shannon entropy estimator under a regularly varying occupancy model","domain":"math.PR","source":"arxiv","authors":["Takato Hashino","Koji Tsukuda"],"reviews":0,"subject":"math.PR","summary":"Estimating the Shannon entropy of discrete distributions with countably infinite support is a challenging problem. In this paper, we investigate the bias of the plug-in estimator $\\hat{H}_n$ for the Shannon entropy $H(\\boldsymbol{p})$ under an occupancy model whose frequency sequence exhibits regular variation with tail index $α\\in(0,1)$. Using Poissonization and the theory of regular variation, we establish the asymptotic relation $|\\mathsf{E}[\\hat H_n] - H(\\boldsymbol{p})| \\sim n^{α-1}L(n)C_α$, where $L$ is a slowly varying function and $C_α$ is an explicit constant depending only on $α$…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-07-30","reactions":{}}