{"id":"arxiv/2602.05460","url":"https://arxiv.org/abs/2602.05460","tags":["math.ST"],"score":0,"title":"Complexity reduction in online stochastic Newton methods with potential O(N d) total cost","domain":"math.ST","source":"arxiv","authors":["Antoine Godichon-Baggioni","Bruno Portier","Guillaume Sallé"],"reviews":0,"subject":"math.ST","summary":"Optimizing smooth convex functions in stochastic settings, where only noisy estimates of gradients and Hessians are available, is a fundamental problem in optimization. While first-order methods possess a low per-iteration cost, their convergence is slow for ill-conditioned problems. Stochastic Newton methods utilize second-order information to correct for local curvature, but the O(d 3 ) per-iteration cost of computing and inverting a full Hessian, where d is the problem dimension, is prohibitive in high dimensions. This paper introduces an online mini-batch stochastic Newton algorithm. The…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-02-05","reactions":{}}