{"id":"arxiv/2606.31390","url":"https://arxiv.org/abs/2606.31390","tags":["math.OC","cs.LG"],"score":0,"title":"Direction-Magnitude Decomposition for Low-Rank Matrix Optimization: Faster Convergence and Saddle-to-saddle Dynamics","domain":"math.OC","source":"arxiv","authors":["Yudong Wei","Liang Zhang","Bingcong Li","Niao He"],"reviews":0,"subject":"math.OC","summary":"Low-rank matrix optimization is often carried out via the Burer-Monteiro (BM) formulation, but choosing the factorization rank $r$ is delicate and can substantially slow optimization. We propose a unified framework, termed direction-magnitude decomposition (DMD), that decomposes the optimization variable to improve optimization efficiency even when the target rank is unknown. We develop two DMD-based approaches and establish their theoretical advantages on the canonical problem of matrix factorization. The first, overparameterized DMD, uses a rank $r$ larger than necessary and enjoys faster…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-30","reactions":{}}