{"id":"arxiv/2603.00945","url":"https://arxiv.org/abs/2603.00945","tags":["math.OC","cs.LG","stat.ML"],"score":0,"title":"Non-Rectangular Average-Reward Robust MDPs: Optimal Policies and Their Transient Values","domain":"math.OC","source":"arxiv","authors":["Shengbo Wang","Nian Si"],"reviews":0,"subject":"math.OC","summary":"We study non-rectangular robust Markov decision processes under the average-reward criterion, where the ambiguity set couples transition probabilities across states and the adversary commits to a stationary kernel for the entire horizon. We show that any history-dependent policy achieving sublinear expected regret uniformly over the ambiguity set is robust-optimal, and that the robust value admits a minimax representation as the infimum over the ambiguity set of the classical optimal gains, without requiring any form of rectangularity or robust dynamic programming principle. Under the weak…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-03-01","reactions":{}}