{"id":"arxiv/2605.11850","url":"https://arxiv.org/abs/2605.11850","tags":["math.OC","cs.LG"],"score":0,"title":"Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives","domain":"math.OC","source":"arxiv","authors":["Konstantinos Oikonomidis","Jan Quan","Kimon Antonakopoulos","Antonio Silveti-Falls","Volkan Cevher","Panagiotis Patrinos"],"reviews":0,"subject":"math.OC","summary":"In this work, we develop proximal preconditioned gradient methods with a focus on spectral gradient methods providing a proximal extension to the Muon and Scion optimizers. We introduce a family of stochastic algorithms that can handle a wide variety of convex and nonconvex constraints and study its convergence under heavy-tailed noise, through a novel analysis tailored to the geometry of the proposed methods. We further propose a variance-reduced version, which achieves faster convergence under standard noise assumptions. Finally, we show that the polynomial iterations used in Muon are more…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-12","reactions":{}}