{"id":"arxiv/2605.29121","url":"https://arxiv.org/abs/2605.29121","tags":["math.DS","cs.AI","cs.LG"],"score":0,"title":"A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router","domain":"math.DS","source":"arxiv","authors":["O. M. Kiselev"],"reviews":0,"subject":"math.DS","summary":"We propose a minimal dynamical model of adaptive softmax routing for a two-expert Mixture-of-Experts (MoE) layer. The model is obtained as a mean-field limit of a discrete reinforcement rule: the selected expert receives a small score increment, while all scores undergo regularizing decay. In the symmetric case the limiting system has a supercritical pitchfork bifurcation: for weak feedback there is a unique stable balanced state, whereas above a critical feedback strength two stable asymmetric states appear. When an external asymmetry is added, the pitchfork unfolds into a pair of fold…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-27","reactions":{}}