{"id":"arxiv/2604.01086","url":"https://arxiv.org/abs/2604.01086","tags":["cs.DS","cs.IT","math.ST"],"score":0,"title":"Sequential Sampling for Binary Classification: Two LLMs are (Almost) All You Need","domain":"cs.DS","source":"arxiv","authors":["Guokai Li","Alys Liang","Mo Liu","Murray Lei","Stefanus Jasin","Fenghua Yang","Preet Baxi"],"reviews":0,"subject":"cs.DS","summary":"We study how to orchestrate multiple large language models (LLMs) for reliable binary classification when models differ in accuracy, monetary cost, and response time. A decision-maker adaptively chooses which LLM to query, updates its belief after each response, and stops once sufficient confidence has been reached. Our results reveal a sharp contrast between exact and near-optimal orchestration. In the worst case, an exactly optimal policy may need to query every available LLM. Yet under high reliability requirements, a simple policy using at most two LLMs is asymptotically optimal. The…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-01","reactions":{}}