{"id":"arxiv/2606.20446","url":"https://arxiv.org/abs/2606.20446","tags":["math.OC"],"score":0,"title":"High-Probability Last-Iterate Guarantees for Two-Point Gaussian Zeroth-Order Stochastic Gradient Descent","domain":"math.OC","source":"arxiv","authors":["Haishan Ye"],"reviews":0,"subject":"math.OC","summary":"We establish a direct high-probability last-iterate guarantee for the standard same-sample two-point Gaussian zeroth-order SGD method in smooth, strongly convex stochastic optimization. At each iteration, the method draws a fresh Gaussian direction, evaluates two symmetric perturbations with the same stochastic sample, and takes a norm-normalized stochastic approximation step. Assuming unbiased stochastic gradients and a conditional exponential-moment bound on the squared norm of the stochastic gradient noise, we prove a finite-horizon bound, valid for dimension \\(d\\ge2\\), with an explicit…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-18","reactions":{}}