{"id":"arxiv/2605.11289","url":"https://arxiv.org/abs/2605.11289","tags":["cs.LG","math.OC"],"score":0,"title":"Quotient-Categorical Representations for Bellman-Compatible Average-Reward Distributional Reinforcement Learning","domain":"cs.LG","source":"arxiv","authors":["Ege C. Kaya","Aliasghar Pourghani","Vijay Gupta","Abolfazl Hashemi"],"reviews":0,"subject":"cs.LG","summary":"Average-reward reinforcement learning requires estimating the gain and the bias, which is defined only up to an additive constant. This makes direct distributional analogues ill-posed on the real line. We introduce a quotient-space formulation in which state-indexed bias laws are identified up to a common translation, together with a categorical parameterization that respects this symmetry. On this quotient-categorical space, we define a projected average-reward distributional operator and show that it is well-defined, non-expansive in a coordinate Cramér metric, and admits fixed points. We…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-11","reactions":{}}