{"id":"arxiv/2602.05065","url":"https://arxiv.org/abs/2602.05065","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Does SGD Seek Flatness or Sharpness? An Exactly Solvable Model","domain":"cs.LG","source":"arxiv","authors":["Yizhou Xu","Pierfrancesco Beneventano","Isaac Chuang","Liu Ziyin"],"reviews":0,"subject":"cs.LG","summary":"A large body of theory and empirical work hypothesizes a connection between the flatness of a neural network's loss landscape during training and its performance. However, there have been conceptually opposite pieces of evidence regarding when SGD prefers flatter or sharper solutions during training. In this work, we partially but causally clarify the flatness-seeking behavior of SGD by identifying and exactly solving an analytically solvable model that exhibits both flattening and sharpening behavior during training. In this model, the SGD training has no \\textit{a priori} preference for…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-04","reactions":{}}