{"id":"arxiv/2602.13960","url":"https://arxiv.org/abs/2602.13960","tags":["cs.LG","math.PR"],"score":0,"title":"Constant-Stepsize Stochastic Approximation: Finite-Time Convergence, Gaussian Approximation, and Tail Bounds","domain":"cs.LG","source":"arxiv","authors":["Zedong Wang","Yuyang Wang","Ijay Narang","Felix Wang","Yuzhou Wang","Siva Theja Maguluri"],"reviews":0,"subject":"cs.LG","summary":"Constant-stepsize stochastic approximation (SA) is widely used in learning for computational efficiency, yet the distribution of the iterates is typically intractable. Classical asymptotics results give $X_k^{(α)} \\approx X^{(α)} \\approx x^\\star+\\sqrtαY$, where $X^{(α)}$ is the steady state and $Y$ is an appropriate Gaussian limit, by progressively taking the time $k\\uparrow\\infty$ and stepsize $α\\downarrow0$. Such limit results, however, do not quantify finite-time, finite-stepsize errors. We develop an explicit pre-limit characterization for SA with i.i.d.\\ and Markovian noise. We…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-15","reactions":{}}