{"id":"arxiv/2601.20582","url":"https://arxiv.org/abs/2601.20582","tags":["cs.CL","cond-mat.stat-mech","math-ph"],"score":0,"title":"Single-Nodal Spontaneous Symmetry Breaking in NLP Models","domain":"cs.CL","source":"arxiv","authors":["Shalom Rosner","Ronit D. Gross","Ella Koresh","Ido Kanter"],"reviews":0,"subject":"cs.CL","summary":"Spontaneous symmetry breaking in statistical mechanics primarily occurs during phase transitions at the thermodynamic limit where the Hamiltonian preserves inversion symmetry, yet the low-temperature free energy exhibits reduced symmetry. Herein, we demonstrate the emergence of spontaneous symmetry breaking in natural language processing (NLP) models during both pre-training and fine-tuning, even under deterministic dynamics and within a finite training architecture. This phenomenon occurs at the level of individual attention heads and is scaled-down to its small subset of nodes and also…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-01-28","reactions":{}}