{"id":"arxiv/2607.21520","url":"https://arxiv.org/abs/2607.21520","tags":["math.OC","math.PR"],"score":0,"title":"Asymptotic Analysis of Empirical Dynamic Programming in Infinite-Horizon Stochastic Optimal Control","domain":"math.OC","source":"arxiv","authors":["Xin Chen","Elif Sena Isik","Johannes Milz"],"reviews":0,"subject":"math.OC","summary":"We derive statistical limit theorems for sample-based approximations of infinite-horizon discounted stochastic optimal control problems in discrete time. Our first result is a functional central limit theorem for the sample-based value function under a uniqueness-type condition on population optimal policies. The limiting law is a mean-zero Gaussian process characterized by a linear fixed point equation that resembles a dynamic programming principle. We compare these asymptotics with those obtained from sample-based policy optimization and illustrate that their limiting variances can be…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-07-23","reactions":{}}