{"id":"arxiv/2602.06567","url":"https://arxiv.org/abs/2602.06567","tags":["math.OC"],"score":0,"title":"Markov Decision Processes of the Third Kind: Learning Distributions by Policy Gradient Descent","domain":"math.OC","source":"arxiv","authors":["Nicole Bäuerle","Athanasios Vasileiadis"],"reviews":0,"subject":"math.OC","summary":"The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law, rather than optimizing an expected value or a risk functional. To solve the resulting distributional control problem in a model-free setting, we propose a policy-gradient algorithm based on neural-network parameterizations of randomized Markov policies, defined on an augmented state space and a sample-based evaluation of the characteristic-function loss. Under…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-02-06","reactions":{}}