{"id":"arxiv/2606.05140","url":"https://arxiv.org/abs/2606.05140","tags":["math.AP","math-ph","math.PR","stat.ML"],"score":0,"title":"Phase transitions for the noisy transformer model in arbitrary dimension","domain":"math.AP","source":"arxiv","authors":["Kyunghoo Mun","Matthew Rosenzweig"],"reviews":0,"subject":"math.AP","summary":"We study the McKean--Vlasov free energy on the unit sphere associated with the unnormalized self-attention (USA) model for noisy transformer dynamics. We prove a sharp global-minimizer dichotomy in every dimension $d\\ge2$. There is a unique $β_*^{(d)}>0$ such that \\begin{equation*} \\frac{I_{d/2+1}(β_*^{(d)})}{I_{d/2}(β_*^{(d)})}=\\frac1d, \\end{equation*} where $I_ν$ is the modified Bessel function of the first kind. For $0 β_*^{(d)}$, the uniform density is not globally minimizing at $K_\\#^{(d)}(β)$, so the critical coupling satisfies $K_c<K_\\#^{(d)}(β)$ and the transition is discontinuous.…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-03","reactions":{}}