{"id":"arxiv/2610.13518","url":"https://arxiv.org/abs/2610.13518","tags":["math.DS","cs.LG","eess.SY"],"score":0,"title":"Asymptotic Analysis of Discrete-Time Self-Attention Dynamics in Transformers","domain":"math.DS","source":"arxiv","authors":["Claudio Altafini"],"reviews":0,"subject":"math.DS","summary":"In machine learning, a self-attention dynamics describes the attention mechanism of transformers, and is obtained treating the layer index of a transformer as time index. Even though naturally discrete-time, this dynamical system is most often studied in continuous-time. Scope of this paper is to provide a thorough investigation of the discrete-time version of the self-attention dynamics: a complete classification of its equilibria is given, and their stability properties are studied, in both the single-head and the multihead case. We show that in both cases the main attractor of the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-09","reactions":{}}