{"id":"arxiv/2605.07634","url":"https://arxiv.org/abs/2605.07634","tags":["math.OC","cs.LG","math.ST"],"score":0,"title":"Robust stochastic first order methods in heavy-tailed noise via medoid mini-batch gradient sampling","domain":"math.OC","source":"arxiv","authors":["Manojlo Vukovic","Dusan Jakovetic"],"reviews":0,"subject":"math.OC","summary":"We consider a first order stochastic optimization framework where, at each iteration, $K$ independent identically distributed (i.i.d.) data point samples are drawn, based on which stochastic gradients can be queried. We allow gradient noise to be heavy-tailed, with possibly infinite variances. For the considered heavy-tailed setting, many algorithmic variants have recently been proposed based on gradient clipping or other nonlinear operators (e.g., normalization) applied over noisy gradients. In this paper, we take an alternative approach and propose a novel stochastic first order method…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-08","reactions":{}}