{"id":"arxiv/2601.16842","url":"https://arxiv.org/abs/2601.16842","tags":["math.ST","stat.ML"],"score":0,"title":"Parametric Mean-Field empirical Bayes in high-dimensional linear regression","domain":"math.ST","source":"arxiv","authors":["Seunghyun Lee","Nabarun Deb"],"reviews":0,"subject":"math.ST","summary":"In this paper, we consider the problem of parametric empirical Bayes estimation of an i.i.d. prior in high-dimensional Bayesian linear regression, with random design. We obtain the asymptotic distribution of the variational Empirical Bayes (vEB) estimator, which approximately maximizes a variational lower bound of the intractable marginal likelihood. We characterize a sharp phase transition behavior for the vEB estimator -- namely that it is information theoretically optimal (in terms of limiting variance) up to $p=o(n^{2/3})$ while it suffers from a sub-optimal convergence rate in higher…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-01-23","reactions":{}}