{"id":"arxiv/2601.01061","url":"https://arxiv.org/abs/2601.01061","tags":["cs.LG","cs.AI","math.PR"],"score":0,"title":"A UCB Bandit Algorithm for General ML-Based Estimators","domain":"cs.LG","source":"arxiv","authors":["Yajing Liu","Erkao Bao","Linqi Song"],"reviews":0,"subject":"cs.LG","summary":"We present ML-UCB, a generalized upper confidence bound algorithm that integrates arbitrary machine learning models into multi-armed bandit frameworks. A fundamental challenge in deploying sophisticated ML models for sequential decision-making is the lack of tractable concentration inequalities required for principled exploration. We overcome this limitation by directly modeling the learning curve behavior of the underlying estimator. Specifically, assuming the Mean Squared Error decreases as a power law in the number of training samples, we derive a generalized concentration inequality and…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-01-03","reactions":{}}