{"id":"arxiv/2605.23872","url":"https://arxiv.org/abs/2605.23872","tags":["cs.LG","math.NA","stat.ML"],"score":0,"title":"Training-Free Looped Transformers","domain":"cs.LG","source":"arxiv","authors":["Lizhang Chen","Jonathan Li","Chen Liang","Ni Lao","Qiang Liu"],"reviews":0,"subject":"cs.LG","summary":"We introduce training-free looped transformers, in which a lightweight inference-time wrapper loops a contiguous mid-stack block of layers of a frozen checkpoint without additional fine-tuning, continued training, or architectural changes. Unlike prior looped transformer methods that train with the looped structure end-to-end, we retrofit recurrence onto pretrained models at test time. We show that naive block reapplication usually degrades performance, highlighting the importance of the loop application strategy. Motivated by viewing a pre-norm transformer block as a forward Euler step on…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-22","reactions":{}}