{"id":"arxiv/2602.22482","url":"https://arxiv.org/abs/2602.22482","tags":["cs.IT","math.CO"],"score":0,"title":"On the Computation Rate of All-Reduce","domain":"cs.IT","source":"arxiv","authors":["Yufeng Zhou","Hua Sun"],"reviews":0,"subject":"cs.IT","summary":"In the All-Reduce problem, each one of the K nodes holds an input and wishes to compute the sum of all K inputs through a communication network where each pair of nodes is connected by a parallel link with arbitrary bandwidth. The computation rate of All-Reduce is defined as the number of sum instances that can be computed over each network use. For the computation rate, we provide a cut-set upper bound and a linear programming lower bound based on time (bandwidth) sharing over all schemes that first perform Reduce (aggregating all inputs at one node) and then perform Broadcast (sending the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-25","reactions":{}}