Multi-LLM Query Optimization

Arlen Dean; Zijin Zhang; Stefanus Jasin; Yuqing Liu

Multi-LLM Query Optimization

Arlen Dean, Zijin Zhang, Stefanus Jasin, Yuqing Liu

arXivarxiv/2603.24617Mar 24, 2026cs.DSscore 0

Deploying multiple large language models (LLMs) in parallel to classify an unknown ground-truth label is a common practice, yet the problem of optimally allocating queries across heterogeneous models remains poorly understood. In this paper, we formulate a robust, offline query-planning problem that minimizes total query cost subject to statewise error constraints which guarantee reliability for every possible ground-truth label. We first establish that this problem is NP-hard via a reduction from the minimum-weight set cover problem. To overcome this intractability, we develop a surrogate…

Source JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2603.24617
curl -X POST /api/v1/records/arxiv/2603.24617/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2603.24617/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'