{"id":"arxiv/2605.10774","url":"https://arxiv.org/abs/2605.10774","tags":["math.ST","stat.ML"],"score":0,"title":"When Are Trade-Off Functions Testable from Finite Samples?","domain":"math.ST","source":"arxiv","authors":["Kaining Shi","Qiaosen Wang","Cong Ma"],"reviews":0,"subject":"math.ST","summary":"We study finite-sample inference for the trade-off function of two unknown probability distributions, the function that traces the optimal type I/type II error frontier in binary testing. Given samples from distributions $P$ and $Q$, we consider the problem of testing whether their trade-off function lies above a benchmark curve $f_0$ or falls below a weaker benchmark $f_1$. Without structural restrictions, this problem is impossible uniformly over nonparametric classes. We identify a sharp condition under which it becomes possible. The key structural assumption is that the Neyman--Pearson…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-11","reactions":{}}