{"id":"arxiv/2607.13295","url":"https://arxiv.org/abs/2607.13295","tags":["math.CO"],"score":0,"title":"On Transformer Dynamics","domain":"math.CO","source":"arxiv","authors":["Mohammad Javad Latifi Jebelli"],"reviews":0,"subject":"math.CO","summary":"We develop a geometric framework in which the token dynamics of a transformer are modeled by a system of interacting particles on a Riemannian manifold $\\mathcal M$, the attention mechanism being encoded by a time-independent two-body interaction law, that is, a section of the pullback bundle $π_2^{*}(T\\mathcal M)$ over $\\mathcal M\\times\\mathcal M$. Within this framework we isolate two features that a family of interaction laws must possess in order to model language: it must realize generic nonlocal and nonreciprocal forces, and it must parametrize vector fields on a high-dimensional…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-07-14","reactions":{}}