{"id":"arxiv/2610.23750","url":"https://arxiv.org/abs/2610.23750","tags":["math.ST","stat.ML"],"score":0,"title":"Exact Tail Laws for Nonlinear SGD with Infinite-Variance Gradients","domain":"math.ST","source":"arxiv","authors":["Xiaoli Li","Qianqian Lei","Ziyang Wei","Wei Biao Wu"],"reviews":0,"subject":"math.ST","summary":"With infinite-variance gradient noise, SGD can have infinite expected excess objective even when most iterates are close to the optimum. We characterize its accuracy through exact first-order tail probabilities for the last iterate of nonlinear, constant-stepsize SGD. For regularly varying innovations of index $t\\in(1,2)$, the leading measure transports one large gradient shock through the local Hessian flow. This is the same measure that governs the central stable Ornstein--Uhlenbeck limit; we prove its relative accuracy at shrinking tolerances above the central scale, with state-dependent…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-16","reactions":{}}