{"id":"arxiv/2606.27610","url":"https://arxiv.org/abs/2606.27610","tags":["math.OC"],"score":0,"title":"Policy Gradient Learning for Distributionally Robust Markov Decision Processes under Wasserstein Ambiguity","domain":"math.OC","source":"arxiv","authors":["Yadh Hafsi","Samy Mekkaoui","Huyên Pham","Kaixin Yan"],"reviews":0,"subject":"math.OC","summary":"We study finite-horizon Markov decision processes under distributional uncertainty in the transition kernels and develop a policy-gradient framework for Wasserstein distributionally robust control. Ambiguity is modeled by Wasserstein balls of common radius centered at state--action-dependent nominal transition kernels, leading to a max--min problem over randomized policies and admissible transition laws. Because the worst-case transition law depends implicitly on the policy parameters, the standard policy-gradient argument does not apply directly. We address this difficulty by combining the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-25","reactions":{}}