{"id":"arxiv/2602.07479","url":"https://arxiv.org/abs/2602.07479","tags":["cs.LG","cs.IT","eess.SP","math.OC"],"score":0,"title":"ODELoRA: Training Low-Rank Adaptation by Solving Ordinary Differential Equations","domain":"cs.LG","source":"arxiv","authors":["Yihang Gao","Vincent Y. F. Tan"],"reviews":0,"subject":"cs.LG","summary":"Low-rank adaptation (LoRA) has emerged as a widely adopted parameter-efficient fine-tuning method in deep transfer learning, due to its reduced number of trainable parameters and lower memory requirements enabled by Burer-Monteiro factorization on adaptation matrices. However, classical LoRA training methods treat the low-rank factor matrices individually and optimize them using standard gradient-based algorithms. Such decoupled optimization schemes are theoretically and empirically suboptimal, as they fail to fully exploit the intrinsic structure of the LoRA parameterization. In this work,…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-07","reactions":{}}