{"id":"arxiv/2603.02069","url":"https://arxiv.org/abs/2603.02069","tags":["cs.LG","cs.AI","math.OC","stat.ML"],"score":0,"title":"Scaling Laws of SignSGD in Linear Regression: When Does It Outperform SGD?","domain":"cs.LG","source":"arxiv","authors":["Jihwan Kim","Dogyoon Song","Chulhee Yun"],"reviews":0,"subject":"cs.LG","summary":"We study scaling laws of signSGD under a power-law random features (PLRF) model that accounts for both feature and target decay. We analyze the population risk of a linear model trained with one-pass signSGD on Gaussian-sketched features. We express the risk as a function of model size, training steps, learning rate, and the feature and target decay parameters. Comparing against the SGD risk analyzed by Paquette et al. (2024), we identify a drift-normalization effect and a noise-reshaping effect unique to signSGD. We then obtain compute-optimal scaling laws under the optimal choice of…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-02","reactions":{}}