{"id":"arxiv/2603.02417","url":"https://arxiv.org/abs/2603.02417","tags":["stat.ML","cs.LG","math.OC"],"score":0,"title":"Mini-Batch Covariance, Diffusion Limits, and Oracle Complexity in Stochastic Gradient Descent: A Sampling-Design Perspective","domain":"stat.ML","source":"arxiv","authors":["Daniel Zantedeschi","Kumar Muthuraman"],"reviews":0,"subject":"stat.ML","summary":"Stochastic gradient descent (SGD) is central to simulation optimization, stochastic programming, and online M-estimation, where sampling effort is a decision variable. We study the mini-batch gradient noise as a sampling-design object. Under exchangeable fresh-sampling mini-batches, the conditional covariance given the de Finetti directing measure mu is b^{-1} G_mu(theta), and under identifiability the projected population object is b^{-1} G*(theta) -- projected Fisher information for correctly specified likelihoods, the sandwich partner of the Hessian otherwise. This identification fixes…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-03-02","reactions":{}}