{"id":"arxiv/2603.09923","url":"https://arxiv.org/abs/2603.09923","tags":["cs.LG","math.NA","math.OC"],"score":0,"title":"OptEMA: Adaptive Exponential Moving Average for Stochastic Optimization with Zero-Noise Optimality","domain":"cs.LG","source":"arxiv","authors":["Ganzhao Yuan"],"reviews":0,"subject":"cs.LG","summary":"Exponential moving averages (EMAs) are a central component of widely used adaptive optimizers such as Adam. However, existing analyses of Adam-style methods often yield suboptimal guarantees in the zero-noise regime, rely on open-loop parameter schedules, or require prior knowledge of smoothness constants. Motivated by these limitations, we introduce OptEMA and analyze two complementary variants: OptEMA-M, which applies an adaptive, decreasing EMA coefficient to the first moment with a fixed second-moment decay, and OptEMA-V, which swaps these roles. At the heart of these variants is a…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-10","reactions":{}}