Entropy Regularization Improves Policy Robustness in Continuous-Time Reinforcement Learning

Jialun Cao, Fernando Acero, David Šiška, Yufei Zhang

arXivarxiv/2607.03168Jul 3, 2026math.OCscore 0

Entropy regularization is widely used in continuous-time reinforcement learning (RL) to reduce sensitivity to environmental perturbations, yet its robustness benefits lack a rigorous theoretical foundation. This paper establishes the first robustness guarantees for entropy-regularized continuous-time Markov decision processes. We show that maximizing an entropy-regularized objective yields a lower bound on a worst-case robust RL problem with joint reward and transition perturbations. We analytically characterize the induced robust sets and prove that they expand monotonically with the…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2607.03168
curl -X POST /api/v1/records/arxiv/2607.03168/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2607.03168/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'