{"id":"arxiv/2611.14088","url":"https://arxiv.org/abs/2611.14088","tags":["math.OC","eess.SY"],"score":0,"title":"Discrete-Time Stochastic Control Beyond i.i.d. Noise","domain":"math.OC","source":"arxiv","authors":["Reyajul Hasan Leon","Ali Devran Kara"],"reviews":0,"subject":"math.OC","summary":"We study discrete-time stochastic control problems where the noise driving the state dynamics is a stationary infinite-order chain rather than an i.i.d. sequence. We formulate the problem as a controlled Markov process by enlarging the state space to include the posterior distribution of the noise given the state-action history. Assuming that the sensitivity of the noise transition kernel to past noise values decays exponentially, we show that the expected total variation distance between the full-history and finite-memory noise filters decays at rate $\\sqrt{N}ρ^{\\sqrt{N}}$. We use this…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-11-10","reactions":{}}