{"id":"arxiv/2611.00236","url":"https://arxiv.org/abs/2611.00236","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"ProLand: A New Infeasible Manifold Optimization Method for LoRA Fine-Tuning","domain":"cs.LG","source":"arxiv","authors":["Chenyu Zhou","Yuxuan Zeng","Qi Deng","Dongdong Ge","Yinyu Ye"],"reviews":0,"subject":"cs.LG","summary":"Low-rank adaptation (LoRA) enables parameter-efficient fine-tuning but can suffer from redundant basis directions. Constraining the basis factor to the Stiefel manifold addresses this redundancy through orthonormality. Landing methods allow temporarily infeasible iterates to explore a neighborhood of the manifold while progressively restoring orthogonality without per-step retractions. To improve optimization efficiency while retaining this flexibility, we introduce ProLand (Product-space Landing), a retraction-free optimizer that combines coordinated factor updates with Muon-style spectral…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-30","reactions":{}}