Sample Complexity for Markov Decision Processes and Stochastic Optimal Control with Static Risk Measures
We present an elementary state augmentation method for a class of static risk measure applied to the total cost for both Markov decision processes (MDPs) and stochastic optimal control (SOC), such that dynamic programming equations can be derived on the augmented space. Through this we discuss the sample complexities of these two problem classes. We demonstrate the application of the proposed approach by developing a general framework for studying risk-averse MDPs and SOCs with distributionally robust functional generated by $φ$-divergences, and obtain new sample complexity results for…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2604.04795
curl -X POST /api/v1/records/arxiv/2604.04795/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2604.04795/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'