{"id":"arxiv/2601.11435","url":"https://arxiv.org/abs/2601.11435","tags":["math.OC","cs.LG"],"score":0,"title":"Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise","domain":"math.OC","source":"arxiv","authors":["Menglian Wang","Zhuanghua Liu","Luo Luo"],"reviews":0,"subject":"math.OC","summary":"This paper studies decentralized stochastic nonconvex optimization problem over row-stochastic networks. We consider the heavy-tailed gradient noise which is empirically observed in many popular real-world applications. Specifically, we propose a decentralized normalized stochastic gradient descent with Pull-Diag gradient tracking, which achieves approximate stationary points with the optimal sample complexity and the near-optimal communication complexity. We further follow our framework to study the setting of undirected networks, also achieving the nearly tight upper complexity bounds.…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-01-16","reactions":{}}