{"id":"arxiv/2607.24041","url":"https://arxiv.org/abs/2607.24041","tags":["math.ST","cs.LG","stat.ML"],"score":0,"title":"The Zero Pattern of a Design Matrix Drives Multiple Descent in Over-parameterized Regression","domain":"math.ST","source":"arxiv","authors":["Kevin Han Huang","Haoyu Ye","Somak Laha","Morgane Austern"],"reviews":0,"subject":"math.ST","summary":"Over-parameterized linear regression has been widely studied over the last decade. However, most existing works assume that the covariates are independent and that their covariance matrices are non-degenerate. In this paper, we relax both assumptions and derive deterministic equivalents for the prediction risk in a vanishing-ridge regime. We show that degeneracy of the covariance matrices and dependence can lead to multiple descent, and characterize where the corresponding peaks can occur. Our proofs use a novel graph representation of the variance profile. We show that maximum matchings and…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-07-27","reactions":{}}