Low-Order Explicit Hessian Imitation Method for Large-Scale Supervised Machine Learning

Yunlang Zhu, Lingjun Guo, Zahra Khatti, Xiaoyi Qu, Chia-Yuan Wu, Lara Zebiane, Frank E. Curtis

arXivarxiv/2605.06945May 7, 2026math.OCscore 0

An algorithm is proposed for solving optimization problems arising in neural network training for supervised learning. The unique feature of the algorithm is the use of an auxiliary loss, in addition to the original loss employed for model training. The purpose of the auxiliary loss is to provide a mechanism for creating a low-order Hessian-type approximation for the original loss. The proposed algorithm employs the resulting low-order second-derivative approximation terms in place of the second-order momentum terms (i.e., squared elements of the gradient of the loss function) in an overall…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2605.06945
curl -X POST /api/v1/records/arxiv/2605.06945/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2605.06945/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'