{"id":"arxiv/2605.15538","url":"https://arxiv.org/abs/2605.15538","tags":["math.OC","eess.SY"],"score":0,"title":"Stochastic Mirror Descent under Iterate-Dependent Markov Noise: Analysis in the Asymptotic and Finite Time Regimes","domain":"math.OC","source":"arxiv","authors":["Anik Kumar Paul","Shalabh Bhatnagar"],"reviews":0,"subject":"math.OC","summary":"We study a stochastic optimization problem in which the sampling distribution depends on the decision variable, and the available samples are generated through an iterate-dependent Markov chain. Such settings arise naturally in problems with decision-dependent uncertainty; however, they introduce bias and temporal dependence, which render standard techniques developed for i.i.d.\\ noise inapplicable. In this work, we analyze the stochastic mirror descent algorithm under iterate-dependent Markov noise. We first establish almost sure convergence for both convex and non-convex problems under the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-15","reactions":{}}