{"id":"arxiv/2605.15403","url":"https://arxiv.org/abs/2605.15403","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"$φ$-Balancing for Mixture-of-Experts Training","domain":"cs.LG","source":"arxiv","authors":["Lizhang Chen","Jonathan Li","Qi Wang","Runlong Liao","Shuozhe Li","Chen Liang","Ni Lao","Qiang Liu"],"reviews":0,"subject":"cs.LG","summary":"Mixture-of-Experts (MoE) models rely on balanced expert utilization to fully realize their scalability. However, existing load-balancing methods are largely heuristic and operate on noisy mini-batch assignment statistics, introducing bias relative to population-level objectives. We propose $φ$-balancing, a principled framework that directly targets population-level expert balance by minimizing a strictly convex, symmetric, and differentiable potential of the expected routing distribution. Using convex duality, we derive an equivalent min-max formulation and obtain a simple online algorithm…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-14","reactions":{}}