Continuized Nesterov Momentum Achieves the $O(\varepsilon^{-7/4})$ Complexity in Smooth Nonconvex Optimization

Julien Hermant; Jean-François Aujol; Charles Dossal; Lorick Huang; Aude Rondepierre; Irène Waldspurger

Continuized Nesterov Momentum Achieves the $O(\varepsilon^{-7/4})$ Complexity in Smooth Nonconvex Optimization

Julien Hermant, Jean-François Aujol, Charles Dossal, Lorick Huang, Aude Rondepierre, Irène Waldspurger

arXivarxiv/2602.05504Feb 5, 2026math.OCscore 0

For first-order optimization of non-convex functions with Lipschitz-continuous gradient and Hessian, the best-known complexity for reaching an $\varepsilon$-approximation of a stationary point is $\mathcal{O}(\varepsilon^{-7/4})$. The existing algorithms achieving this bound are based on momentum, but are always complemented with safeguard mechanisms that erase the accumulated momentum if a certain condition is violated. Whether such momentum-control mechanisms are fundamentally necessary has remained an open question. We show that randomizing the parameters enables one to achieve this…

Source JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2602.05504
curl -X POST /api/v1/records/arxiv/2602.05504/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2602.05504/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'