{"id":"arxiv/2601.05056","url":"https://arxiv.org/abs/2601.05056","tags":["math.OC","eess.SY"],"score":0,"title":"ZIVR: An Incremental Variance Reduction Technique For Zeroth-Order Composite Problems","domain":"math.OC","source":"arxiv","authors":["Silan Zhang","Yujie Tang"],"reviews":0,"subject":"math.OC","summary":"This paper investigates zeroth-order (ZO) finite-sum composite optimization. Recently, variance reduction techniques have been applied to ZO methods to mitigate the non-vanishing variance of 2-point estimators in constrained/composite optimization, yielding improved convergence rates. However, existing ZO variance reduction methods typically involve batch sampling of size at least $Θ(n)$ or $Θ(d)$, which can be computationally prohibitive for large-scale problems. In this work, we propose a general variance reduction framework, Zeroth-Order Incremental Variance Reduction (ZIVR), which…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-01-08","reactions":{}}