Safeguarded Accelerated Adaptive Search under Unreliable Gradient Oracles
From the probabilistic-model viewpoint, stochastic adaptive search can require any fraction $θ\in(0,1)$ of the predicted model reduction for acceptance. Classical backtracking with Nesterov acceleration pairs its momentum construction with a test certifying $1/2$ of this reduction. In stochastic search, however, rejection entails a fresh oracle query without updating the iterates. We therefore separate the fraction required by the search from that used to construct momentum, allowing smaller search fractions to ease acceptance and potentially reduce the oracle cost of reaching a target…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2604.15526
curl -X POST /api/v1/records/arxiv/2604.15526/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2604.15526/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'