{"id":"arxiv/2610.24538","url":"https://arxiv.org/abs/2610.24538","tags":["math.OC","cs.LG","stat.ML"],"score":0,"title":"Accelerating Finite-Sum Bilevel Optimization with Fully First-Order Oracles","domain":"math.OC","source":"arxiv","authors":["Qihao Zhou","Shanshui Niu"],"reviews":0,"subject":"math.OC","summary":"We study nonconvex--strongly-convex bilevel optimization with finite-sum objectives and fully first-order oracles. We propose Sampled Implicit Corrections for Bilevel Optimization (SICBO), which combines a penalty approximation with variance-reduced corrections for the lower-level variables. Under componentwise lower strong convexity, SICBO finds a point $x$ satisfying $\\mathbb{E}\\|\\nablaΦ(x)\\|^2\\le\\varepsilon^2$ within $\\tilde{O}(N+\\sqrt{N}κ^{7/2}\\varepsilon^{-2})$ component-gradient calls, where $N$ is the total number of components and $κ$ is the normalized lower-level condition number.…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-17","reactions":{}}