Stationarity Floors and Vanishing Perturbations in Sharpness-Aware Minimization
We study a deterministic family of sharpness-aware minimization methods for smooth nonconvex functions. The perturbation is $$ y_k=x_k+ρ\, \frac{\nabla f(x_k)}{\norm{\nabla f(x_k)}^α}, \qquad 0\leqα\leq 1, $$ so that its effective radius is $ρ\norm{\nabla f(x_k)}^{1-α}$. For $0<α\leq1$, we give an explicit complexity bound above the stationarity level $(Lρ)^{1/α}$. A one-dimensional quadratic example reaches this level exactly, showing that the bound describes a real limitation of the constant-parameter rule. The unnormalized case $α=0$ is treated separately and requires $Lρ<1$. We then…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2608.06692
curl -X POST /api/v1/records/arxiv/2608.06692/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2608.06692/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'