{"id":"arxiv/2609.19599","url":"https://arxiv.org/abs/2609.19599","tags":["math.ST"],"score":0,"title":"Human-Anchored Inference for Ranking New Models with Large Language Model Judges","domain":"math.ST","source":"arxiv","authors":["Xin Zhou","Sinian Zhang","Zhanyan Yang","Mingyuan Xu","Molei Liu","Doudou Zhou"],"reviews":0,"subject":"math.ST","summary":"Human pairwise comparisons provide a reference for evaluating large language models (LLMs), but collecting sufficient judgments for each new release is costly and time-consuming. LLM judges offer a scalable alternative, although their comparisons may differ systematically from human preferences and across judges. We study the ranking of a new model that has received LLM-judge comparisons but no human comparisons. We propose ANCHOR (ANchored Comparisons for Human-reference inference with Orthogonal Riesz correction), which uses historical human and LLM comparisons to learn judge-specific…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-09-17","reactions":{}}