{"id":"arxiv/2606.20547","url":"https://arxiv.org/abs/2606.20547","tags":["cs.LG","cs.CV","cs.GR","cs.RO","math.DG"],"score":0,"title":"The Token Is a Group Element: On Lie-Algebra Attention over Matrix Lie Groups","domain":"cs.LG","source":"arxiv","authors":["Przemyslaw Musialski"],"reviews":0,"subject":"cs.LG","summary":"We place the attention token on the group: a token is an element $g_i$ of a matrix Lie group $G$ -- a bare transformation, with no feature payload and no external action $ρ(g)$ carrying it. To our knowledge this is the first attention construction whose tokens are bare matrix Lie group elements: their score is the closed-form algebra norm of the relative pose rather than a learned kernel, and it reaches the affine full-frame groups that every irrep- or surjective-exp-based method must exclude. We call it Lie-Algebra Attention. Once tokens are group elements, the rest follows with none of the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-18","reactions":{}}