Adaptive Normalized Gradient Method for $(L_0,L_1)$-smooth Problems: Estimating Problem Parameters as a Region
We propose a parameter-free and efficient gradient descent algorithm for $(L_0,L_1)$-smooth optimization. This notion of smoothness, introduced by Zhang et al. (2020), allows the smoothness bound to grow with the gradient norm. Similar to cutting-plane localization, our method uses a sequence of observations to maintain a region of plausible values for $(L_0,L_1)$ and uses this region to select step sizes. In the convex setting, our method attains the standard iteration complexity bound $\tilde{\mathcal{O}}\left(\left(L_0/ε+ L_1^2\right)\|x^0-x^*\|^2\right)$ for finding an $ε$-optimal…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2610.27681
curl -X POST /api/v1/records/arxiv/2610.27681/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.27681/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'