{"id":"arxiv/2602.08372","url":"https://arxiv.org/abs/2602.08372","tags":["cs.LG","math.OC"],"score":0,"title":"Dynamic Regret via Discounted-to-Dynamic Reduction with Applications to Curved Losses and Adam Optimizer","domain":"cs.LG","source":"arxiv","authors":["Yan-Feng Xie","Yu-Jie Zhang","Peng Zhao","Zhi-Hua Zhou"],"reviews":0,"subject":"cs.LG","summary":"We study dynamic regret minimization in non-stationary online learning, with a primary focus on follow-the-regularized-leader (FTRL) methods. FTRL is important for curved losses and for understanding adaptive optimizers such as Adam, yet existing dynamic regret analyses are less explored for FTRL. To address this, we build on the discounted-to-dynamic reduction and present a modular way to obtain dynamic regret bounds of FTRL-related problems. Specifically, we focus on two representative curved losses: linear regression and logistic regression. Our method not only simplifies existing proofs…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-09","reactions":{}}