Long-Run Conditional Value at Risk Reinforcement Learning

Qixin Wang, Hao Cao, Jian-Qiang Hu, Mingjie Hu, Li Xia

arXivarxiv/2603.09734Mar 10, 2026math.OCscore 0

We propose a reinforcement learning method for minimizing the long-run conditional value at risk (CVaR) in Markov decision processes with finite state and action spaces. The method uses a single sample trajectory to update a quantile estimate, a $Q$-function, and a randomized policy, without requiring knowledge of transition probabilities or cost distributions. Under appropriate conditions, we show that the estimates track their changing targets as the policy is updated and exploration decreases, even when the proportion of updates for some state and action pairs tends to zero. With a strict…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2603.09734
curl -X POST /api/v1/records/arxiv/2603.09734/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2603.09734/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'