{"id":"arxiv/2602.09057","url":"https://arxiv.org/abs/2602.09057","tags":["math.NA","cs.LG","math.OC"],"score":0,"title":"SVD-Preconditioned Gradient Descent Method for Solving Nonlinear Least Squares Problems","domain":"math.NA","source":"arxiv","authors":["Zhipeng Chang","Wenrui Hao","Nian Liu"],"reviews":0,"subject":"math.NA","summary":"This paper introduces a novel optimization algorithm designed for nonlinear least-squares problems. The method is derived by preconditioning the gradient descent direction using the Singular Value Decomposition (SVD) of the Jacobian. This SVD-based preconditioner is then integrated with the first- and second-moment adaptive learning rate mechanism of the Adam optimizer. We establish the local linear convergence of the proposed method under standard regularity assumptions and prove global convergence for a modified version of the algorithm under suitable conditions. The effectiveness of the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-02-07","reactions":{}}