{"id":"arxiv/2602.06930","url":"https://arxiv.org/abs/2602.06930","tags":["cs.LG","math.OC","math.ST","stat.ML"],"score":0,"title":"Continuous-time reinforcement learning: ellipticity enables model-free value function approximation","domain":"cs.LG","source":"arxiv","authors":["Wenlong Mou"],"reviews":0,"subject":"cs.LG","summary":"We study off-policy reinforcement learning for controlling continuous-time Markov diffusion processes with discrete-time observations and actions. We consider model-free algorithms with function approximation that learn value and advantage functions directly from data, without unrealistic structural assumptions on the dynamics. Leveraging the ellipticity of the diffusions, we establish a new class of Hilbert-space positive definiteness and boundedness properties for the Bellman operators. Based on these properties, we propose the Sobolev-prox fitted $q$-learning algorithm, which learns value…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-06","reactions":{}}