{"id":"arxiv/2605.13639","url":"https://arxiv.org/abs/2605.13639","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Achieving $ε^{-2}$ Sample Complexity for Single-Loop Actor-Critic under Minimal Assumptions","domain":"cs.LG","source":"arxiv","authors":["Ishaq Hamza","Zaiwei Chen"],"reviews":0,"subject":"cs.LG","summary":"In this paper, we establish last-iterate convergence rates for off-policy actor--critic methods in reinforcement learning. In particular, under a single-loop, single-timescale implementation and a broad class of policy updates, including approximate policy iteration and natural policy gradient methods, we prove the first $\\tilde{\\mathcal{O}}(ε^{-2})$ sample complexity guarantee for finding an $ε$-optimal policy under minimal assumptions, namely, the existence of a policy that induces an irreducible Markov chain. This stands in stark contrast to the existing literature, where an…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-13","reactions":{}}