{"id":"arxiv/2611.19518","url":"https://arxiv.org/abs/2611.19518","tags":["math.AP","cs.LG","math.PR"],"score":0,"title":"Equilibrium measures for anisotropic exponential interaction energies with applications to transformers","domain":"math.AP","source":"arxiv","authors":["Oleksii Kachaiev","Martin Burger","Samira Kabri","Yury Korolev","Tim Roith"],"reviews":0,"subject":"math.AP","summary":"We study the minimization of anisotropic exponential interaction energies over probability measures on the sphere, motivated by mean-field models of self-attention in transformer architectures. For every symmetric positive definite interaction matrix, we relate the minimizer to a corresponding anisotropic Brownian motion and use the Feynman--Kac formula and elliptic regularity theory to show that it admits a smooth, strictly positive density on the sphere. We further show that it is the only stationary measure with full support for the dynamics considered. We use the stochastic viewpoint to…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-11-14","reactions":{}}