{"id":"arxiv/2607.26032","url":"https://arxiv.org/abs/2607.26032","tags":["math.OC"],"score":0,"title":"Optimization under Persistent State-Dependent Bias: Gradient-based Method and Complexity Analysis","domain":"math.OC","source":"arxiv","authors":["Zhaoxian Wu","Quan Xiao","Tayfun Gokmen","Tianyi Chen"],"reviews":0,"subject":"math.OC","summary":"This paper studies the convergence of stochastic gradient descent (SGD) when the implemented updates are subject to a persistent and state-dependent bias, in which the desired update is scaled by response functions component-wise. Our first contribution is to demonstrate that SGD in this setting implicitly optimizes a penalized problem whose minimizer does not coincide with the true minimizer. To mitigate this convergence failure, we reformulate the original task as an equivalent bilevel optimization problem and propose a gradient-based algorithm, termed Residual Learning. Theoretical…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-07-28","reactions":{}}