{"id":"arxiv/2605.24939","url":"https://arxiv.org/abs/2605.24939","tags":["cs.LG","math.OC"],"score":0,"title":"Global linear convergence of entropy-regularized softmax policy gradient beyond tabular MDPs","domain":"cs.LG","source":"arxiv","authors":["Ziyue Chen","David Šiška","Lukasz Szpruch"],"reviews":0,"subject":"cs.LG","summary":"We study the global convergence of policy gradient for infinite-horizon entropy-regularized Markov decision processes (MDPs) with continuous state and action spaces. We consider log-linear softmax policies with linear function approximation, which extend the tabular softmax parameterization while retaining a tractable policy class. Under $Q^π_τ$-realizability for the regularized state-action value function, we first establish a non-uniform Polyak--Łojasiewicz (PŁ) inequality. The non-uniformity arises through degeneracy of constants associated with the policy geometry, namely the Fisher…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-24","reactions":{}}