Sharp Initialization Guarantees for the Heavy-Ball Method

Kang Liu, Quanen Wu, Zhan Sun, Mengxiao Chen, Suyan Li, Bohao Qu

arXivarxiv/2610.10369Oct 7, 2026math.OCscore 0

The heavy-ball method can accelerate convergence near the minimizer, but it may also enter persistent oscillations on general strongly convex objectives. How should it be initialized to reliably realize this local advantage? We study the initialization neighborhood in which convergence can be guaranteed using only curvature and regularity bounds. This neighborhood shrinks as momentum approaches one; for Lipschitz-continuous Hessians, its radius is of the same order as damping. Matching upper and lower bounds show that this initialization requirement cannot be relaxed uniformly over the…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2610.10369
curl -X POST /api/v1/records/arxiv/2610.10369/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.10369/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'