{"id":"arxiv/2602.16849","url":"https://arxiv.org/abs/2602.16849","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"On the Mechanism and Dynamics of Modular Addition: Fourier Features, Lottery Ticket, and Grokking","domain":"cs.LG","source":"arxiv","authors":["Jianliang He","Leda Wang","Siyu Chen","Zhuoran Yang"],"reviews":0,"subject":"cs.LG","summary":"We present a comprehensive analysis of how two-layer neural networks learn features to solve the modular addition task. Our work provides a full mechanistic interpretation of the learned model and a theoretical explanation of its training dynamics. While prior work has identified that individual neurons learn single-frequency Fourier features and phase alignment, it does not fully explain how these features combine into a global solution. We bridge this gap by formalizing a diversification condition that emerges during training when overparametrized, consisting of two parts: phase symmetry…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-18","reactions":{}}