{"id":"arxiv/2610.38313","url":"https://arxiv.org/abs/2610.38313","tags":["cs.AI","cs.GT","cs.LG","math.OC"],"score":0,"title":"Game-Theoretic Foundations for Undiscounted Bisimulation Metrics","domain":"cs.AI","source":"arxiv","authors":["Matthew Zurek","Yudong Chen","Josiah P. Hanna"],"reviews":0,"subject":"cs.AI","summary":"Bisimulation metrics offer a principled notion of task-relevant state similarity in reinforcement learning, but existing constructions and methods are largely confined to discounted MDPs, where contraction arguments ensure well-defined fixed points and downstream guarantees. We develop a unified foundation for bisimulation metrics in undiscounted settings, that is total- and average-reward problems, by replacing the standard operator-centric view with a game-centric one: we interpret prior metric operators as Bellman-Shapley operators of zero-sum turn-based games and define metrics as the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-28","reactions":{}}