{"id":"arxiv/2606.10383","url":"https://arxiv.org/abs/2606.10383","tags":["math.OC","math.NA"],"score":0,"title":"A stochastic gradient algorithm for non-separable optimization with convergence guarantee","domain":"math.OC","source":"arxiv","authors":["Yingzhou Li","Ruofan Wu"],"reviews":0,"subject":"math.OC","summary":"We study non-separable objectives in which the loss depend on dataset-level quantities. We introduce an SGD-style framework that employs two batch-gradient constructs: the ideal per-batch gradient `$G$' and a cached surrogate `$H$' for cases where full-data terms are expensive. Notably, in the sample-wise separable case, our method reduces to standard mini-batch SGD. Our main contribution is a unified local convergence theory: under mild smoothness and Jacobian-boundedness assumptions, we prove local linear convergence under local strong convexity and local $O(1/k)$ sublinear convergence…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-09","reactions":{}}