{"id":"arxiv/2604.27372","url":"https://arxiv.org/abs/2604.27372","tags":["math.OC","cs.LG","cs.MA"],"score":0,"title":"Continuous-time q-learning for mean-field control with common noise, part-I: Theoretical foundations","domain":"math.OC","source":"arxiv","authors":["Zhenjie Ren","Xiaoli Wei","Xiang Yu","Xun Yu Zhou"],"reviews":0,"subject":"math.OC","summary":"This paper investigates the continuous-time counterpart of the Q-function for entropy-regularized mean-field control (MFC) with controlled common noise, coined as q-function by Jia and Zhou (2023) in the single agent's model. We first show that, under discretely sampled actions, the value function in the exploratory formulation converges to the one in the relaxed control formulation as the time grid refines. Leveraging the relaxed control formulation, we derive the exploratory Hamilton-Jacobi-Bellman (HJB) equation, in which the controlled common noise gives rise to an additional nonlinear…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-04-30","reactions":{}}