{"id":"arxiv/2603.10219","url":"https://arxiv.org/abs/2603.10219","tags":["stat.ML","cs.AI","cs.LG","math.ST"],"score":0,"title":"A Diffusion Analysis of Policy Gradient for Stochastic Bandits","domain":"stat.ML","source":"arxiv","authors":["Tor Lattimore"],"reviews":0,"subject":"stat.ML","summary":"We study a continuous-time diffusion approximation of policy gradient for $k$-armed stochastic bandits. We prove that with a learning rate $η= O(Δ^2/\\log(n))$ the regret is $O(k \\log(k) \\log(n) / η)$ where $n$ is the horizon and $Δ$ the minimum gap. Moreover, we construct an instance with only logarithmically many arms for which the regret is linear unless $η= O(Δ^2)$.","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-03-10","reactions":{}}