{"id":"arxiv/2602.07997","url":"https://arxiv.org/abs/2602.07997","tags":["stat.ML","cs.LG","math.ST","stat.CO","stat.ME"],"score":0,"title":"Fast Model Selection and Stable Optimization for Softmax-Gated Multinomial-Logistic Mixture of Experts Models","domain":"stat.ML","source":"arxiv","authors":["TrungKhang Tran","TrungTin Nguyen","Md Abul Bashar","Nhat Ho","Richi Nayak","Christopher Drovandi"],"reviews":0,"subject":"stat.ML","summary":"Mixture-of-Experts (MoE) architectures combine specialized predictors through a learned gate and are effective across regression and classification, but for classification with softmax multinomial-logistic gating, rigorous guarantees for stable maximum-likelihood training and principled model selection remain limited. We address both issues in the full-data (batch) regime. First, we derive a batch minorization-maximization (MM) algorithm for softmax-gated multinomial-logistic MoE using an explicit quadratic minorizer, yielding coordinate-wise closed-form updates that guarantee monotone…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-02-08","reactions":{}}