{"id":"arxiv/2605.16747","url":"https://arxiv.org/abs/2605.16747","tags":["cs.LG","math.AP","math.OC","math.PR","math.ST"],"score":0,"title":"Propagation of Chaos in Contextual Flow Maps","domain":"cs.LG","source":"arxiv","authors":["Shi Chen","Zhengjiang Lin","Kaizhao Liu","Philippe Rigollet"],"reviews":0,"subject":"cs.LG","summary":"We develop a quantitative statistical theory of transformers in the large-context regime by adopting the abstraction of contextual flow maps (CFMs): dynamical systems that evolve a distinguished token in the presence of a contextual measure across a stack of attention blocks. Within this framework, the finite-context model approximates an idealized infinite-context system in which the contextual measure is replaced by its underlying population, so that the context length $n$ becomes a statistical resource. Exploiting the McKean--Vlasov structure of the dynamics and the classical machinery of…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-16","reactions":{}}