Reinforcement Learning for Discounted and Ergodic Control of Diffusion Processes

Erhan Bayraktar, Ali D. Kara, Somnath Pradhan, Serdar Yuksel

arXivarxiv/2603.13155Mar 13, 2026math.OCscore 0

This paper develops a quantized Q-learning algorithm for the optimal control of controlled diffusion processes on $\mathbb{R}^d$ under both discounted and ergodic (average) cost criteria. We first establish near-optimality of finite-state MDP approximations to discrete-time discretizations of the diffusion, then introduce a quantized Q-learning scheme and prove its almost-sure convergence to near-optimal policies for the finite MDP. These policies, when interpolated to continuous time, are shown to be near-optimal for the original diffusion model under discounted costs and -- via a…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2603.13155
curl -X POST /api/v1/records/arxiv/2603.13155/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2603.13155/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'