{"id":"arxiv/2602.08478","url":"https://arxiv.org/abs/2602.08478","tags":["cs.LG","math.DS","math.NA"],"score":0,"title":"Time-Delayed Transformers for Data-Driven Modeling of Low-Dimensional Dynamics","domain":"cs.LG","source":"arxiv","authors":["Albert Alcalde","Markus Widhalm","Emre Yılmaz"],"reviews":0,"subject":"cs.LG","summary":"We propose the time-delayed transformer (TD-TF), a simplified transformer architecture for data-driven modeling of unsteady spatio-temporal dynamics. TD-TF bridges linear operator-based methods and deep sequence models by showing that a single-layer, single-head transformer can be interpreted as a nonlinear generalization of time-delayed dynamic mode decomposition (TD-DMD). The architecture is deliberately minimal, consisting of one self-attention layer with a single query per prediction and one feedforward layer, resulting in linear computational complexity in sequence length and a small…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-09","reactions":{}}