{"id":"arxiv/2608.26288","url":"https://arxiv.org/abs/2608.26288","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Muon with Finite Newton-Schulz: The Smoothing Benefit in Nonsmooth Nonconvex Optimization","domain":"cs.LG","source":"arxiv","authors":["Mingyi Li","Taira Tsuchiya"],"reviews":0,"subject":"cs.LG","summary":"Muon has emerged as a strong optimizer for the matrix-valued parameters in large language model pretraining, approximately orthogonalizing its momentum with a few Newton-Schulz iterations. Existing theory either replaces this iteration with the exact polar factor it approximates, or treats its finite depth as an approximation error, and thus the iteration Muon actually runs can only hurt the guarantees. We show that finite Newton-Schulz can instead be beneficial for nonsmooth nonconvex optimization. To this end, we analyze Muon through the online-to-nonconvex conversion, which views the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-26","reactions":{}}