{"id":"arxiv/2609.24522","url":"https://arxiv.org/abs/2609.24522","tags":["math.OC"],"score":0,"title":"Convergence of Rotation-based Matrix Optimizers: A Unified Analysis of SOAP, Conda, and SPlus","domain":"math.OC","source":"arxiv","authors":["Yiwen Sun","Huan Li","Zhouchen Lin"],"reviews":0,"subject":"math.OC","summary":"In this work, we develop a unified theoretical framework for analyzing the convergence of rotation-based matrix optimizers, which apply orthogonal transformations to map the momentum into a rotated space, perform coordinate-wise or normalized updates there, and then rotate the updates back. Our framework encompasses prominent matrix optimizers, including SOAP, Conda, and truncated SPlus, as well as matrix-parameterized Adam as a special case. As our main result, we establish, for the first time, the convergence rate of SOAP with sharp dimensional dependence, as well as the convergence rate…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-09-21","reactions":{}}