{"id":"arxiv/2605.17177","url":"https://arxiv.org/abs/2605.17177","tags":["math.OC","cs.LG","math.ST","stat.ML"],"score":0,"title":"High-dimensional Limit of SGD for Diagonal Linear Networks","domain":"math.OC","source":"arxiv","authors":["Begoña García Malaxechebarría","Courtney Paquette","Maryam Fazel","Dmitriy Drusvyatskiy"],"reviews":0,"subject":"math.OC","summary":"Understanding the behavior of stochastic gradient methods is a central problem in modern machine learning. Recent work has highlighted diagonal linear networks as a simplified yet expressive setting for analyzing the optimization and generalization properties of neural models. In this work, we show that in the high-dimensional regime, stochastic gradient descent on diagonal linear networks is well-approximated by continuous dynamics governed by a stochastic differential equation (SDE), which explicitly decouples the drift from the gradient noise. We further derive a deterministic partial…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-16","reactions":{}}