{"id":"arxiv/2606.31429","url":"https://arxiv.org/abs/2606.31429","tags":["math.ST","cs.LG","stat.ML"],"score":0,"title":"The Geometry of Statistical Feature Learning in Mean-Field Langevin Dynamics","domain":"math.ST","source":"arxiv","authors":["Zong Shang","Tomoya Wakayama","Guillaume Lecué","Taiji Suzuki"],"reviews":0,"subject":"math.ST","summary":"We introduce a geometric formulation of statistical feature learning for supervised regression. Feature learning is defined through a base--fiber decomposition: the base is the feature-side geometry produced by training, and the fiber is the learned feature space where estimation is performed. We prove this property for spherical mean-field Langevin dynamics, viewed as the Wasserstein gradient flow of a negative entropy-regularized empirical risk. In Gaussian multi-index models, the low-temperature stationary distribution concentrates near the hidden indices, forms a multi-spike structure,…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-30","reactions":{}}