{"id":"arxiv/2605.06945","url":"https://arxiv.org/abs/2605.06945","tags":["math.OC"],"score":0,"title":"Low-Order Explicit Hessian Imitation Method for Large-Scale Supervised Machine Learning","domain":"math.OC","source":"arxiv","authors":["Yunlang Zhu","Lingjun Guo","Zahra Khatti","Xiaoyi Qu","Chia-Yuan Wu","Lara Zebiane","Frank E. Curtis"],"reviews":0,"subject":"math.OC","summary":"An algorithm is proposed for solving optimization problems arising in neural network training for supervised learning. The unique feature of the algorithm is the use of an auxiliary loss, in addition to the original loss employed for model training. The purpose of the auxiliary loss is to provide a mechanism for creating a low-order Hessian-type approximation for the original loss. The proposed algorithm employs the resulting low-order second-derivative approximation terms in place of the second-order momentum terms (i.e., squared elements of the gradient of the loss function) in an overall…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-07","reactions":{}}