{"id":"arxiv/2606.10562","url":"https://arxiv.org/abs/2606.10562","tags":["math.OC","cs.LG","math.NA"],"score":0,"title":"Accelerating SAV-based optimization via randomized low-rank Hessian approximation","domain":"math.OC","source":"arxiv","authors":["Ryo Sagawa","Daisuke Furihata","Yuto Miyatake"],"reviews":0,"subject":"math.OC","summary":"We propose a new optimization method, the Nyström-enhanced relaxed scalar auxiliary variable method (N-RSAV), which incorporates curvature information into the RSAV framework to accelerate convergence while preserving an unconditional modified energy dissipation law. Existing RSAV-based methods rely solely on first-order information and often suffer from slow convergence, particularly for ill-conditioned problems such as those arising in physics-informed neural networks (PINNs). To address this limitation, we design the linear operator in the RSAV scheme using approximate Hessian information…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-09","reactions":{}}