PhiBE-Q-Learning: Bridging Off-Policy Reinforcement Learning and Continuous-Time Control
In this paper, we develop an off-policy method for continuous-time reinforcement learning (CTRL), where the system dynamics are governed by an unknown stochastic differential equation (SDE) and only discrete-time trajectory data are available. A central challenge is that the classical discrete-time state--action value function loses its action-dependent signal in the continuous-time limit (Baird, 1994; Jia and Zhou, 2023; Tallec et al., 2019). On the other hand, continuous-time control provides local notions such as the instantaneous advantage function $q(s,a)$, but these typically rely on…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2606.21925
curl -X POST /api/v1/records/arxiv/2606.21925/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2606.21925/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'