{"id":"arxiv/2611.05075","url":"https://arxiv.org/abs/2611.05075","tags":["math.OC"],"score":0,"title":"Variance Reduction Note 4: The Convergence of SVRG","domain":"math.OC","source":"arxiv","authors":["Alina Lodhi"],"reviews":0,"subject":"math.OC","summary":"Stochastic variance-reduced gradient (SVRG) uses a full gradient at a snapshot point to correct inexpensive component gradients. This fourth expository note on variance reduction explains that control variate and gives a self-contained proof of linear convergence for the classical strongly convex finite-sum setting. Each component is assumed convex and smooth, while only their average must be strongly convex. A second-moment bound links the estimator to the objective gaps at the current iterate and the snapshot. Summing a distance recursion over an epoch then yields a geometric decrease and…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-11-03","reactions":{}}