Model-free Reinforcement Learning for Continuous Time and State: A Stochastic Maximum Principle Approach
This paper develops a model-free reinforcement learning (RL) algorithm based on the stochastic maximum principle for continuous-time stochastic control problems with continuous state and action spaces. For a parameterized Markovian policy, we establish the existence of the decoupling field for the adjoint backward stochastic differential equation, which allows the Hamiltonian gradient to be represented as a deterministic function of time and state. We then learn this Hamiltonian gradient directly from data and incorporate it into a policy gradient scheme with inexact gradients. We establish…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2609.38745
curl -X POST /api/v1/records/arxiv/2609.38745/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2609.38745/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'