{"id":"arxiv/2603.19808","url":"https://arxiv.org/abs/2603.19808","tags":["cs.LG","math.AP","stat.ML"],"score":0,"title":"Two-Time-Scale Learning Dynamics: A Population View of Neural Network Training","domain":"cs.LG","source":"arxiv","authors":["Giacomo Borghi","Hyesung Im","Lorenzo Pareschi"],"reviews":0,"subject":"cs.LG","summary":"Population-based learning paradigms, including evolutionary strategies, Population-Based Training (PBT), and recent model-merging methods, combine fast within-model optimisation with slower population-level adaptation. Despite their empirical success, a general mathematical description of the resulting collective training dynamics remains incomplete. We introduce a theoretical framework for neural network training based on two-time-scale population dynamics. We model a population of neural networks as an interacting agent system in which network parameters evolve through fast noisy gradient…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-20","reactions":{}}