K-Means as the Zero-Temperature Limit of Normalized RBF Assignments: Rates, Trajectories, and Exact Recovery with Entmax

Felipe de Jesus Felix Arredondo; Manuel Alejandro Ucan Puc; Carlos Astengo Nouguez

K-Means as the Zero-Temperature Limit of Normalized RBF Assignments: Rates, Trajectories, and Exact Recovery with Entmax

Felipe de Jesus Felix Arredondo, Manuel Alejandro Ucan Puc, Carlos Astengo Nouguez

arXivarxiv/2603.04625Mar 4, 2026cs.LGscore 0

K-Means is usually treated as a discrete procedure outside gradient-based learning, whereas normalized radial basis function (RBF) layers are smooth. We make precise the sense in which K-Means is the zero-temperature limit of such a layer. Relaxing the K-Means assignments to the simplex with a Shannon entropy penalty yields the normalized Gaussian RBF responsibilities and a reduced objective $F_σ$ with $0\le J-F_σ\le 2nσ^2\log k$, so $F_σ$ $Γ$-converges to the K-Means distortion $J$. We keep four levels of statement apart. For the objective, minimal values and minimizers converge, and above…

Source JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2603.04625
curl -X POST /api/v1/records/arxiv/2603.04625/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2603.04625/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'