{"id":"arxiv/2602.08232","url":"https://arxiv.org/abs/2602.08232","tags":["math.OC","cs.LG","stat.ML"],"score":0,"title":"Adaptive Matrix Online Learning through Smoothing with Guarantees for Nonsmooth Nonconvex Optimization","domain":"math.OC","source":"arxiv","authors":["Ruichen Jiang","Zakaria Mhammedi","Mehryar Mohri","Aryan Mokhtari"],"reviews":0,"subject":"math.OC","summary":"We study online linear optimization with matrix variables constrained by the operator norm, a setting where the geometry renders designing data-dependent and efficient adaptive algorithms challenging. The best-known adaptive regret bounds are achieved by Shampoo-like methods, but they require solving a costly quadratic projection subproblem. To address this, we extend the gradient-based prediction scheme to adaptive matrix online learning and cast algorithm design as constructing a family of smoothed potentials for the nuclear norm. We define a notion of admissibility for such smoothings and…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-02-09","reactions":{}}