{"id":"arxiv/2603.07703","url":"https://arxiv.org/abs/2603.07703","tags":["cs.LG","math.NA"],"score":0,"title":"Step-Size Decay and Structural Stagnation in Greedy Sparse Learning","domain":"cs.LG","source":"arxiv","authors":["Pablo M. Berná"],"reviews":0,"subject":"cs.LG","summary":"Greedy algorithms are central to sparse approximation and stage-wise learning methods such as matching pursuit and boosting. It is known that the Power-Relaxed Greedy Algorithm with step sizes $m^{-α}$ may fail to converge when $α>1$ in general Hilbert spaces. In this work, we revisit this phenomenon from a sparse learning perspective. We study realizable regression problems with controlled feature coherence and derive explicit lower bounds on the residual norm, showing that over-decaying step-size schedules induce structural stagnation even in low-dimensional sparse settings. Numerical…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-08","reactions":{}}