{"id":"arxiv/2605.02701","url":"https://arxiv.org/abs/2605.02701","tags":["math.OC","cs.LG","stat.ML"],"score":0,"title":"Robust and Fast Training via Per-Sample Clipping","domain":"math.OC","source":"arxiv","authors":["Davide Nobile","Philipp Grohs"],"reviews":0,"subject":"math.OC","summary":"We propose a robust gradient estimator based on per-sample gradient clipping and analyze its properties both theoretically and empirically. We show that the resulting method, per-sample clipped SGD (PS-Clip-SGD), achieves optimal in-expectation convergence rates for non-convex optimization problems under heavy-tailed gradient noise. Moreover, we establish high-probability convergence guarantees that match the in-expectation rates up to polylogarithmic factors in the failure probability. We complement our theoretical results with multiple numerical experiments. In particular, we demonstrate…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-04","reactions":{}}