{"id":"arxiv/2606.15832","url":"https://arxiv.org/abs/2606.15832","tags":["cs.LG","math.OC"],"score":0,"title":"SILAGE: Memory-Efficient, Full-Gradient-Free Nonconvex Optimization for Nested Finite Sums","domain":"cs.LG","source":"arxiv","authors":["Igor Sokolov","Laurent Condat","Peter Richtárik"],"reviews":0,"subject":"cs.LG","summary":"Empirical risk minimization on massive datasets naturally exhibits a nested double finite-sum structure, where $N=nm$ total samples are logically or physically partitioned into $n$ blocks of size $m$ (e.g., in pooled data silos, out-of-core learning, or deliberate stratification). While variance-reduced methods achieve optimal oracle complexities for nonconvex objectives, they suffer from severe scaling bottlenecks in this centralized regime. Recursive estimators, such as PAGE, require periodic global full-gradient refreshes over all $nm$ samples, which are computationally expensive.…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-14","reactions":{}}