Forgetting matters: when subspace optimization accelerates without the strong convexity parameter

Ilya Kuruzov, Alexander Vyguzov, Ivan Dorofeev, Alexander Gasnikov

arXivarxiv/2611.00727Oct 31, 2026math.OCscore 0

Sequential subspace optimization (SESOP) minimizes the objective exactly over a few directions built from past iterates. It needs no problem constants, is accelerated on smooth convex functions and behaves like an accelerated method in experiments. This led to the conjecture that it is accelerated in the strongly convex case without knowing the strong convexity parameter. We show that the conjecture fails in the worst case. For every subspace method whose memory forgets slowly, namely a window of recent gradients and steps together with cumulative sums with subexponential weights, we…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2611.00727
curl -X POST /api/v1/records/arxiv/2611.00727/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2611.00727/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'