{"id":"arxiv/2602.01434","url":"https://arxiv.org/abs/2602.01434","tags":["cs.LG","math.ST"],"score":0,"title":"Phase Transitions for Feature Learning in Neural Networks","domain":"cs.LG","source":"arxiv","authors":["Andrea Montanari","Zihao Wang"],"reviews":0,"subject":"cs.LG","summary":"According to a popular viewpoint, neural networks learn from data by first identifying low-dimensional representations, and subsequently fitting the best model in this space. Recent works provide a formalization of this phenomenon when learning multi-index models. In this setting, we are given $n$ i.i.d. pairs $({\\boldsymbol x}_i,y_i)$, where the covariate vectors ${\\boldsymbol x}_i\\in\\mathbb{R}^d$ are isotropic, and responses $y_i$ only depend on ${\\boldsymbol x}_i$ through a $k$-dimensional projection ${\\boldsymbol Θ}_*^{\\sf T}{\\boldsymbol x}_i$. Feature learning amounts to learning the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-01","reactions":{}}