{"id":"arxiv/2603.23658","url":"https://arxiv.org/abs/2603.23658","tags":["cs.LG","math.NA","math.OC"],"score":0,"title":"Boost Like a (Var)Pro: Trust-Region Gradient Boosting via Variable Projection","domain":"cs.LG","source":"arxiv","authors":["Abhijit Chowdhary","Elizabeth Newman","Deepanshu Verma"],"reviews":0,"subject":"cs.LG","summary":"Gradient boosting, a method of building additive ensembles from weak learners, has established itself as a practical and theoretically-motivated approach to approximate functions, especially using decision tree weak learners. Comparable methods for smooth parametric learners, such as neural networks, remain less developed in both training methodology and theory. To this end, we introduce \\texttt{VPBoost} ({\\bf V}ariable {\\bf P}rojection {\\bf Boost}ing), a gradient boosting algorithm for separable smooth approximators, i.e., models with a smooth nonlinear featurizer followed by a final linear…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-24","reactions":{}}