{"id":"arxiv/2603.00009","url":"https://arxiv.org/abs/2603.00009","tags":["math.OC","math.PR"],"score":0,"title":"Non-Exchangeable Mean Field Markov Decision Processes with common noise : from Bellman equation to quantitative propagation of chaos","domain":"math.OC","source":"arxiv","authors":["Samy Mekkaoui","Huyên Pham"],"reviews":0,"subject":"math.OC","summary":"We study infinite-horizon Markov Decision Processes (MDPs) with a continuum of heterogeneous agents interacting through a common noise, without assuming exchangeability. We introduce the framework of Conditional Non-Exchangeable Mean Field MDPs (CNEMF-MDPs) in both a strong formulation and a label-state formulation. We establish the equivalence between these two formulations by showing that the control problem can be lifted to a standard MDP defined on the Wasserstein space of probability measures over the product of the label and state spaces. Here, the label space represents agent…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-01-26","reactions":{}}