{"id":"arxiv/2610.07290","url":"https://arxiv.org/abs/2610.07290","tags":["math.OC","cs.LG"],"score":0,"title":"A Single-Loop, Constant-Batch First-Order Penalty Method for Stochastic Bilevel Optimization","domain":"math.OC","source":"arxiv","authors":["Xingyu Chen","Ming Yang","Quanqi Hu","Tianbao Yang"],"reviews":0,"subject":"math.OC","summary":"Recent advances in penalty-based methods for stochastic bilevel optimization (SBO) have eliminated the need for second-order derivative oracles. However, for stochastic nonconvex-strongly convex bilevel problems, existing first-order methods typically rely on nested loops and/or large batch sizes for attaining $O(ε^{-6})$ or $O(ε^{-4})$ sample complexity under standard bounded-variance assumption or mean-square smoothness assumption. Achieving these rates with a single-loop penalty method and a constant batch size remains challenging due to a large penalty value needed for an accurate…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-05","reactions":{}}