{"id":"arxiv/2606.21925","url":"https://arxiv.org/abs/2606.21925","tags":["math.OC"],"score":0,"title":"PhiBE-Q-Learning: Bridging Off-Policy Reinforcement Learning and Continuous-Time Control","domain":"math.OC","source":"arxiv","authors":["Yuhua Zhu"],"reviews":0,"subject":"math.OC","summary":"In this paper, we develop an off-policy method for continuous-time reinforcement learning (CTRL), where the system dynamics are governed by an unknown stochastic differential equation (SDE) and only discrete-time trajectory data are available. A central challenge is that the classical discrete-time state--action value function loses its action-dependent signal in the continuous-time limit (Baird, 1994; Jia and Zhou, 2023; Tallec et al., 2019). On the other hand, continuous-time control provides local notions such as the instantaneous advantage function $q(s,a)$, but these typically rely on…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-20","reactions":{}}