{"id":"arxiv/2603.06759","url":"https://arxiv.org/abs/2603.06759","tags":["math.ST"],"score":0,"title":"A New Estimator of Kullback--Leibler Divergence via Shannon Entropy","domain":"math.ST","source":"arxiv","authors":["Mehmet Siddik Cadirci","Martin Singull"],"reviews":0,"subject":"math.ST","summary":"We examine the estimation of the Kullback-Leibler (KL) divergence and the use of the goodness-of-fit test for multivariate continuous distributions. Our starting point is the maximum entropy principle for Shannon entropy: among all distributions with a fixed mean vector and covariance matrix, the multivariate Gaussian distributions uniquely maximize entropy. As a result, the KL divergence from a moment-matched Gaussian distribution to an unknown density can then be written as the \\emph{entropy difference}, which is a suitable information-theoretic measure of divergence from the Gaussian…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-03-06","reactions":{}}