{"id":"arxiv/2601.01306","url":"https://arxiv.org/abs/2601.01306","tags":["cs.LG","math.OC"],"score":0,"title":"Towards a Principled Muon under $μ\\mathsf{P}$: Ensuring Spectral Conditions throughout Training","domain":"cs.LG","source":"arxiv","authors":["John Zhao"],"reviews":0,"subject":"cs.LG","summary":"The $μ$-parameterization ($μ$P) provides a principled foundation for large language model (LLM) training by prescribing width-independent learning dynamics, which in turn enables predictable scaling behavior and robust hyperparameter transfer across model sizes. A central requirement of $μ$P is the satisfaction of certain spectral conditions on weight matrices, which ensure consistent feature learning and optimization behavior as model width grows. While these conditions are well understood in theory, guaranteeing their validity in practical training for matrix-based optimizers such as Muon…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-01-04","reactions":{}}