{"id":"arxiv/2609.19712","url":"https://arxiv.org/abs/2609.19712","tags":["math.OC"],"score":0,"title":"(Cheap) Stochastic Policy Gradient Converges with High Probability for Linear Quadratic Regulator","domain":"math.OC","source":"arxiv","authors":["Yan Li","Chengze Xie"],"reviews":0,"subject":"math.OC","summary":"We study the convergence of the vanilla stochastic policy gradient method applied to the linear quadratic regulator (LQR) problem. The method is cheap in the following sense: (1) at each iteration only $\\tilde{O}(1)$ interactions with the environment are needed, therefore allowing frequent policy improvement steps, and (2) to ensure stability throughout and convergence to an $ε$-optimal policy with probability $1-δ$, only $O(\\mathtt{Polylog}(1/δ)/ε)$ interactions are needed. To the best of our knowledge, this appears to be the first time that a stochastic model-free policy optimization…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-09-17","reactions":{}}