{"id":"arxiv/2610.16845","url":"https://arxiv.org/abs/2610.16845","tags":["stat.ML","cs.LG","math.OC"],"score":0,"title":"Feature Normalization under Finite Training Budgets","domain":"stat.ML","source":"arxiv","authors":["Johan Larsson"],"reviews":0,"subject":"stat.ML","summary":"Standardizing a rare feature can help stochastic gradient descent learn its effect within a finite budget, but it also changes the noise cost of learning. We characterize the lowest rare-subgroup risks attainable by standardized and unscaled training when each chooses a nonnegative constant learning rate and a deterministic stopping time under the same observation cap. For two independent binary features, we derive both optimized risks as prevalence vanishes while the expected number of rare observations remains finite. Uniform control over rates and stopping times reduces each limiting…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-10-12","reactions":{}}