{"id":"arxiv/2601.22897","url":"https://arxiv.org/abs/2601.22897","tags":["math.OC"],"score":0,"title":"Grassmannian Geometry and Global Convergence of Variable Projection for Neural Networks","domain":"math.OC","source":"arxiv","authors":["Mathias Dus"],"reviews":0,"subject":"math.OC","summary":"Training deep neural networks and Physics-Informed Neural Networks (PINNs) often leads to ill-conditioned and stiff optimization problems. A key structural feature of these models is that they are linear in the output-layer parameters and nonlinear in the hiddenlayer parameters, yielding a separable nonlinear least-squares formulation. In this work, we study the classical variable projection (VarPro) method for such problems in the context of deep neural networks. We provide a geometric formulation on the Grassmannian and analyze the structure of critical points and convergence properties of…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-01-30","reactions":{}}