{"id":"arxiv/2610.18043","url":"https://arxiv.org/abs/2610.18043","tags":["stat.CO","math.OC","stat.ME"],"score":0,"title":"How to Train Your Intercept: A Comparison of Intercept Update Strategies in Coordinate Descent","domain":"stat.CO","source":"arxiv","authors":["Johan Larsson","Frederik Fabricius-Bjerre"],"reviews":0,"subject":"stat.CO","summary":"Coordinate descent solvers for regularized generalized linear models (GLMs) differ in how they update the intercept. This seemingly routine choice can substantially affect convergence when the response is imbalanced. For direct coordinate descent on the original GLM loss, we compare a conservative step based on worst-case curvature, a safeguarded Newton step based on current curvature, and repeated Newton steps that solve the intercept subproblem. The conservative update can leave much of the interaction between the intercept and the coefficients unresolved, producing a slowdown when that…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-10-13","reactions":{}}