Pursuing Optimal Stepsize in Adaptive Gradient-Based Quadratic Optimization

Yifan Wang, Luca Ballotta, Ruggero Carli, Xianghui Cao, Luca Schenato

arXivarxiv/2608.03546Aug 4, 2026math.OCscore 0

In this paper, we address the problem of achieving fast convergence in gradient descent for quadratic functions without relying on a priori knowledge of global function parameters. Inspired by adaptive stepsize algorithms for smooth convex functions, we propose a computationally lightweight strategy based on running estimates of minimal and maximal local curvatures. We prove that our proposed algorithm converges to the optimal constant stepsize which achieves the fastest convergence. Simulations show that the convergence rate achieved by our proposed algorithm is comparable or superior to…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2608.03546
curl -X POST /api/v1/records/arxiv/2608.03546/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2608.03546/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'