{"id":"arxiv/2609.34791","url":"https://arxiv.org/abs/2609.34791","tags":["math.OC","cs.LG"],"score":0,"title":"Finite-Time Concentration and Convergence Rates for Projected Two-Time-Scale Stochastic Approximation with Markov Noise","domain":"math.OC","source":"arxiv","authors":["Rahul Singh","Vivek S. Borkar","Eric Moulines"],"reviews":0,"subject":"math.OC","summary":"We study finite-time concentration and convergence rates for projected two-time-scale stochastic approximation driven by a controlled Markov chain. The averaged fast map is contractive, while the slow iterate is projected onto a compact convex polyhedron. The associated projected ordinary differential equation may have a discontinuous vector field at the boundary, preventing a direct application of standard analyses based on Lipschitz vector fields. Using the Skorokhod map, we establish explicit high-probability bounds for tracking the moving fast equilibrium and the projected slow dynamics.…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-09-28","reactions":{}}