{"id":"arxiv/2605.17394","url":"https://arxiv.org/abs/2605.17394","tags":["math.OC"],"score":0,"title":"Stochastic Zeroth-Order Optimization Under Heavy-Tailed Noise","domain":"math.OC","source":"arxiv","authors":["Taha El Bakkali","El Mahdi Chayti","Qiuyi Zhang","Imane Rahali","Omar Saadi"],"reviews":0,"subject":"math.OC","summary":"We study stochastic zeroth-order (ZO) optimization of smooth nonconvex objectives under heavy-tailed sample-gradient noise. This regime is motivated by empirical evidence that gradient noise in modern machine learning can violate the bounded-variance assumptions used in classical ZO theory. While first-order methods have optimal rates under bounded $p$-th moment noise for $p\\in(1,2]$, analogous high-probability guarantees for nonconvex ZO methods are much less understood. The ZO setting is not a direct corollary of first-order theory. First-order methods observe stochastic gradients, whereas…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-17","reactions":{}}