{"id":"arxiv/2602.22047","url":"https://arxiv.org/abs/2602.22047","tags":["math.OC","math.ST"],"score":0,"title":"Stochastic Optimal Control with Side Information and Bayesian Learning","domain":"math.OC","source":"arxiv","authors":["Johannes Milz","Alexander Shapiro","Enlu Zhou"],"reviews":0,"subject":"math.OC","summary":"We study infinite-horizon stochastic optimal control problems with observable side information: a Markov chain that modulates an unknown context-conditional randomness distribution. Since this distribution is unknown, we propose a Bayesian reformulation based on a parametric density model and posterior predictive dynamics, which yields a Bayesian Bellman equation. We prove posterior consistency under Markov samples and, under correct specification and identifiability, uniform convergence of the Bayesian value function. Finally, we establish Bernstein--von Mises-type asymptotic normality for…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-02-25","reactions":{}}