{"id":"arxiv/2611.05835","url":"https://arxiv.org/abs/2611.05835","tags":["cs.LG","math.OC"],"score":0,"title":"Pathwise-Budgeted LLM Routing: Online Allocation with K-Bit Tail-Cost Learning","domain":"cs.LG","source":"arxiv","authors":["Hanzhang Qin","Sophie H. Yu","Yuewei Zhang","Zhi-Hai Zhang"],"reviews":0,"subject":"cs.LG","summary":"Firms using large language models under fixed budgets must decide which model to call and whether to retry a failed task. Because a call's charge is revealed only after completion, one long response can exhaust the remaining budget and leave later tasks unserved. Our objective is to maximize the number of tasks solved before service stops. We develop a contextual bandit policy, ADP-HT, which learns each model's task-specific success probability and constructs conservative cost estimates from coarsened response-length labels on a quantile grid with $2^K$ intervals. The policy weighs predicted…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-04","reactions":{}}