{"id":"arxiv/2602.16392","url":"https://arxiv.org/abs/2602.16392","tags":["math.OC","math.PR"],"score":0,"title":"Partially observed controlled Markov chains and optimal control of the Wonham filter","domain":"math.OC","source":"arxiv","authors":["Fulvia Confortola","Marco Fuhrman"],"reviews":0,"subject":"math.OC","summary":"We consider a class of optimal control problems, with finite or infinite horizon, for a continuous-time Markov chain with finite state space. In this case, the control process affects the transition rates. We suppose that the controlled process can not be observed, and at any time the control actions are chosen based on the observation of a related stochastic process perturbed by an exogenous Brownian motion. We describe a construction of the controlled Markov chain, having stochastic transition rates adapted to the observation filtration. By a change of probability measure of Girsanov type,…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-02-18","reactions":{}}