Tight Heavy-Tailed Complexity Bounds for Optimizing Polyak--Łojasiewicz Objectives
We study optimizing $L$-smooth and $μ$-Polyak-Lojasiewicz (PL) objectives with unbiased stochastic gradients under $α$-heavy-tailed noise ($1<α\le 2$). In the unrestricted high-dimensional setting, we establish the noise-adaptive lower bound for attaining $ε$-suboptimal function value. Under the generalized mirror-PL condition, we propose a centered-clipped mirror-descent method that achieves a high-probability upper bound matching the lower bound up to logarithmic factors. We further provide the improved tight stochastic complexity in fixed dimensions.
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2609.03990
curl -X POST /api/v1/records/arxiv/2609.03990/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2609.03990/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'