{"id":"arxiv/2607.18425","url":"https://arxiv.org/abs/2607.18425","tags":["math.ST"],"score":0,"title":"Mutual Information second order expansion is the Pearson's chi-square statistic","domain":"math.ST","source":"arxiv","authors":["Marius Marinescu"],"reviews":0,"subject":"math.ST","summary":"We show that MI connects subtly and elegantly the two best-known state-of-the-art independence test statistics: the $G^2$ and the Pearson's chi-square statistic $χ^2$. Furthermore, we show that the MI connects directly those statistics by an elegant formula arising from a stochastic Taylor expansion of MI ($δ$-method). MI second order term is precisely $χ^2$ up to a scale factor. As a consequence, by this connection, the difference between $G^2$ and $χ^2$ can be explicitly quantified.","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-07-20","reactions":{}}