{"id":"arxiv/2603.02639","url":"https://arxiv.org/abs/2603.02639","tags":["math.OC","cs.LG"],"score":0,"title":"Convex and Non-convex Federated Learning with Stale Stochastic Gradients: Diminishing Step Size is All You Need","domain":"math.OC","source":"arxiv","authors":["Xinran Zheng","Tara Javidi","Behrouz Touri"],"reviews":0,"subject":"math.OC","summary":"We propose a general framework for distributed stochastic optimization under delayed gradient models. In this setting, $n$ local agents leverage their own data and computation to assist a central server in minimizing a global objective composed of agents' local cost functions. Each agent is allowed to transmit stochastic-potentially biased and delayed-estimates of its local gradient. While a prior work has advocated delay-adaptive step sizes for stochastic gradient descent (SGD) in the presence of delays, we demonstrate that a pre-chosen diminishing step size is sufficient and matches the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-03-03","reactions":{}}