{"id":"arxiv/2604.02505","url":"https://arxiv.org/abs/2604.02505","tags":["math.OC","cs.LG"],"score":0,"title":"Optimal Projection-Free Adaptive SGD for Matrix Optimization","domain":"math.OC","source":"arxiv","authors":["Dmitry Kovalev"],"reviews":0,"subject":"math.OC","summary":"Recently, Jiang et al. [2026] developed Leon, a practical variant of One-sided Shampoo [Xie et al., 2025a, An et al., 2025] algorithm for online convex optimization, which does not require computing a costly quadratic projection at each iteration. Unfortunately, according to the existing analysis, Leon requires tuning an additional hyperparameter in its preconditioner and cannot achieve dimension-independent convergence guarantees for convex optimization problems beyond the bounded gradients assumption. In this paper, we resolve this issue by proving certain stability properties of Leon's…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-04-02","reactions":{}}