{"id":"arxiv/2611.01658","url":"https://arxiv.org/abs/2611.01658","tags":["math.OC"],"score":0,"title":"Long-Time Behavior of Zero-Noise Mean-Field Adam","domain":"math.OC","source":"arxiv","authors":["Ethan Huffman","Asaf Cohen"],"reviews":0,"subject":"math.OC","summary":"Adaptive methods such as Adam are the most commonly used methods for training neural networks, but their long-time behavior is not as well understood as that of non-adaptive methods. This is particularly true in the mean-field limit, where the dynamics of infinitely many neurons are described as a distribution over parameters which satisfies a self-consistency condition. In this paper, we study a deterministic continuous-time model of Adam in the mean-field setting. Under a condition relating the averaging rates of the momentum and second-moment variables, the size of the gradients, and a…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-11-01","reactions":{}}