{"id":"arxiv/2608.23211","url":"https://arxiv.org/abs/2608.23211","tags":["math.OC","cs.LG"],"score":0,"title":"SGHA: A Single-Loop Fully First-Order Algorithm for Nonconvex-Strongly-Convex Bilevel Optimization","domain":"math.OC","source":"arxiv","authors":["Zhihao Gu","Qilong Wu","Junchi Yang"],"reviews":0,"subject":"math.OC","summary":"In this work, we study the oracle complexity of finding an $ε$-stationary point for nonconvex-strongly-convex (NC-SC) bilevel optimization using only first-order oracles. Existing methods achieving the best-known complexity guarantees typically rely on double-loop, penalty-based procedures. We propose a novel single-loop algorithm based on a constrained reformulation in which lower-level stationarity is imposed as a constraint. Specifically, we construct a regularized Lagrangian by introducing a quadratic regularizer and restricting the dual variable to a bounded domain, and then apply…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-08-24","reactions":{}}