{"id":"arxiv/2601.11217","url":"https://arxiv.org/abs/2601.11217","tags":["math.OC","cs.LG"],"score":0,"title":"Model-free policy gradient for discrete-time mean-field control","domain":"math.OC","source":"arxiv","authors":["Matthieu Meunier","Huyên Pham","Christoph Reisinger"],"reviews":0,"subject":"math.OC","summary":"We study model-free policy learning for discrete-time mean-field control (MFC) problems with finite state space and compact action space. In contrast to the extensive literature on value-based methods for MFC, policy-based approaches remain largely unexplored due to the intrinsic dependence of transition kernels and rewards on the evolving population state distribution, which prevents the direct use of likelihood-ratio estimators of policy gradients from classical single-agent reinforcement learning. We introduce a novel perturbation scheme on the state-distribution flow and prove that the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-01-16","reactions":{}}