{"id":"arxiv/2608.04245","url":"https://arxiv.org/abs/2608.04245","tags":["math.OC"],"score":0,"title":"Strong error analysis for the stochastic momentum optimizer","domain":"math.OC","source":"arxiv","authors":["Davide Gallon","Arnulf Jentzen"],"reviews":0,"subject":"math.OC","summary":"Stochastic gradient descent (SGD) optimization schemes are the methods of choice for the optimization of deep neural networks (DNNs) in artificial intelligence (AI) systems. Often not the standard SGD method is used but instead suitable accelerated, adaptive, and/or normalized variants of standard SGD such as Adam, AdamW, and MUON are employed to train large scale AI systems in practically relevant settings. The acceleration (higher order convergence speed) in all these popular optimizers relies on the momentum SGD optimizer. In this work we provide a rigorous error analysis for the momentum…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-08-04","reactions":{}}