{"id":"arxiv/2604.15632","url":"https://arxiv.org/abs/2604.15632","tags":["math.AG","stat.ML"],"score":0,"title":"Algebraic Invariants of Lightning Self-Attention","domain":"math.AG","source":"arxiv","authors":["Yulia Alexandr","Hao Duan","Guido Montúfar"],"reviews":0,"subject":"math.AG","summary":"We study the polynomial coefficients of lightning self-attention as coordinates of an algebraic variety. In the single-token case, we characterize the coefficient variety as a rank-constrained Chow-type variety and derive algebraic equations from this description. For multiple tokens, linear relations reduce the nonlinear geometry to coefficients involving interactions between distinct tokens. We characterize the resulting variety by a common linear factor together with a low-rank condition on the remaining factors. This structure yields explicit families of determinantal, Veronese-type, and…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-04-17","reactions":{}}