Exact (Non-)Accelerations of Heavy-Ball Discretizations
Source: arxiv.org/abs/2611.13584
Momentum methods with the same slow dynamics can have different worst-case rates on smooth strongly convex functions. We identify a half-step phase barrier in the gradient query that governs this difference. For momentum with extrapolation $τ_κ\toτ$, $β=1-θ/\sqrtκ+o(κ^{-1/2})$ and $hL\to y$, where $κ=L/μ$ and $θ,y>0$, the exact uniform distance factor is $1-c/\sqrtκ+o(κ^{-1/2})$, with $c=\min\{θ/3,c_Q(θ,y)\}$, when $τ>1/2$ and $y(1+2τ)<4$; $c_Q$ is the slowest quadratic decay exponent. Quadratically accelerated families with $\limsupτ_κ<1/2$ have divergent trajectories on the full function…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2611.13584
curl -X POST /api/v1/records/arxiv/2611.13584/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2611.13584/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'