{"id":"arxiv/2610.26742","url":"https://arxiv.org/abs/2610.26742","tags":["math.NA","cs.LG","math.OC"],"score":0,"title":"Polar Switch: Fast Muon Orthogonalization with Polynomial Circuits","domain":"math.NA","source":"arxiv","authors":["Zhehang Du","Weijie Su"],"reviews":0,"subject":"math.NA","summary":"Muon, a 2024-born optimizer for language models, differs from the 2015-born spectral gradient descent mainly in its fast, GPU-friendly Newton--Schulz polynomial for orthogonalizing the gradient matrix. Accordingly, a line of research proposes faster polynomial iterations for gradient orthogonalization, such as Polar Express and Gram Newton--Schulz, both built on quintic polynomials. In this paper, we introduce Polar Switch, a new approach to polynomial gradient orthogonalization. Using simple polynomial circuits, Polar Switch reaches a given high polynomial degree at a lower FLOP cost than…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-19","reactions":{}}