{"id":"arxiv/2602.10838","url":"https://arxiv.org/abs/2602.10838","tags":["math.OC"],"score":0,"title":"Mirror descent actor-critic methods for entropy regularised MDPs in general spaces: stability and convergence","domain":"math.OC","source":"arxiv","authors":["Denis Zorba","David Šiška","Lukasz Szpruch"],"reviews":0,"subject":"math.OC","summary":"We provide theoretical guarantees for convergence of discrete-time policy mirror descent with inexact advantage functions updated using temporal difference (TD) learning for entropy regularised MDPs in Polish state and action spaces. We rigorously derive sufficient conditions under which the single-loop actor-critic scheme is stable and convergent. To weaken these conditions, we introduce a variant that performs multiple TD steps per policy update and derive an explicit lower bound on the number of TD steps required to ensure stability. Finally, we establish sub-linear convergence when the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-02-11","reactions":{}}