Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size

Quang Dinh Thien Nguyen, Duc Anh Nguyen, Hoang Huy Nguyen, Siva Theja Maguluri

arXivarxiv/2602.10580Feb 11, 2026math.OCscore 0

We study the almost sure convergence of the Stochastic Approximation algorithm to the fixed point $x^\star$ of a nonlinear operator under a negative drift condition and a general noise sequence with finite $p$-th moment for some $p > 1$. Classical almost sure convergence results of Stochastic Approximation are mostly analyzed for the square-integrable noise setting, and it is shown that any non-summable but square-summable step size sequence is sufficient to obtain almost sure convergence. However, such a limitation prevents wider algorithmic application. In particular, many applications in…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2602.10580
curl -X POST /api/v1/records/arxiv/2602.10580/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2602.10580/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'