Id: arxiv/2611.19518 Url: https://arxiv.org/abs/2611.19518 Tags: math.AP, cs.LG, math.PR Score: 0 Title: Equilibrium measures for anisotropic exponential interaction energies with applications to transformers Domain: math.AP Source: arxiv Authors: Oleksii Kachaiev, Martin Burger, Samira Kabri, Yury Korolev, Tim Roith Reviews: 0 Subject: math.AP Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-11-14 Page: https://delphi.science/r/arxiv/2611.19518 We study the minimization of anisotropic exponential interaction energies over probability measures on the sphere, motivated by mean-field models of self-attention in transformer architectures. For every symmetric positive definite interaction matrix, we relate the minimizer to a corresponding anisotropic Brownian motion and use the Feynman--Kac formula and elliptic regularity theory to show that it admits a smooth, strictly positive density on the sphere. We further show that it is the only stationary measure with full support for the dynamics considered. We use the stochastic viewpoint to…