High-Probability Last-Iterate Guarantees for Two-Point Gaussian Zeroth-Order Stochastic Gradient Descent
We establish a direct high-probability last-iterate guarantee for the standard same-sample two-point Gaussian zeroth-order SGD method in smooth, strongly convex stochastic optimization. At each iteration, the method draws a fresh Gaussian direction, evaluates two symmetric perturbations with the same stochastic sample, and takes a norm-normalized stochastic approximation step. Assuming unbiased stochastic gradients and a conditional exponential-moment bound on the squared norm of the stochastic gradient noise, we prove a finite-horizon bound, valid for dimension \(d\ge2\), with an explicit…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2606.20446
curl -X POST /api/v1/records/arxiv/2606.20446/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2606.20446/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'