{"id":"arxiv/2602.18003","url":"https://arxiv.org/abs/2602.18003","tags":["math.OC","cs.CC"],"score":0,"title":"Policy Gradient Algorithms in Average-Reward Multichain MDPs","domain":"math.OC","source":"arxiv","authors":["Jongmin Lee","Ernest K. Ryu"],"reviews":0,"subject":"math.OC","summary":"While there is an extensive body of research analyzing policy gradient methods for discounted cumulative-reward MDPs, prior work on policy gradient methods for average-reward MDPs has been limited, with most existing results restricted to ergodic or unichain settings. In this work, we first establish a policy gradient theorem for average-reward multichain MDPs based on the invariance of the classification of recurrent and transient states. Building on this foundation, we develop refined analyses and obtain a collection of convergence and sample-complexity results that advance the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-02-20","reactions":{}}