{"id":"arxiv/2605.12801","url":"https://arxiv.org/abs/2605.12801","tags":["math.NA"],"score":0,"title":"Fast and Stable Gradient Approximation for Bilinear Forms of Hermitian Matrix Functions","domain":"math.NA","source":"arxiv","authors":["Navjot Singh","Kipton Barros","Xiaoye Sherry Li"],"reviews":0,"subject":"math.NA","summary":"Objectives involving bilinear forms $u^\\top f(A(θ))v$ for Hermitian $A$ arise widely in scientific computing and probabilistic machine learning. For large matrices, Lanczos efficiently approximates these quantities, but differentiating them with respect to $θ$ is challenging. Existing approaches either backpropagate through the Lanczos recurrence, requiring reorthogonalization for stability, or apply Arnoldi to an augmented block matrix of twice the original size. Both introduce extra computation and orthogonalization costs that can limit performance on modern hardware. We propose a…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-12","reactions":{}}