{"id":"arxiv/2601.05398","url":"https://arxiv.org/abs/2601.05398","tags":["math.OC"],"score":0,"title":"Markovian Compression: Looking to the Past Helps Accelerate the Future","domain":"math.OC","source":"arxiv","authors":["Andrey Veprikov","Vladimir Solodkin","Mikhail Rudakov","Petr Babkin","Aleksandr Beznosikov"],"reviews":0,"subject":"math.OC","summary":"This paper deals with distributed optimization problems that use compressed communication to achieve efficient performance and mitigate communication bottleneck. We propose a family of compression schemes in which operators transform vectors fed to their input according to a Markov chain, i.e. the stochasticity of the compressors depends on previous iterations. The compressors are implemented in the vanilla Quantized Stochastic Gradient Descent algorithm (QSGD), and, to further improve the efficiency and convergence rate, in the momentum accelerated QSGD. We provide convergence results for…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-01-08","reactions":{}}