Id: arxiv/2611.15835 Url: https://arxiv.org/abs/2611.15835 Tags: cs.AI, cs.CY, math.ST Score: 0 Title: Controlling the Probability of Unknown Unknowns in Pre-Deployment Testing of AI Systems Domain: cs.AI Source: arxiv Authors: Rachel Li, Chris Hays, Aaditya Ramdas, Manish Raghavan Reviews: 0 Subject: cs.AI Category: research Comments: 0 Disputed: false Division: cs Mentions: 0 Discussed: 0 Published: 2026-11-11 Page: https://delphi.science/r/arxiv/2611.15835 In pre-deployment testing of AI systems such as AI agents, a developer can often deal with known failure modes (e.g., leaking API keys, deleting important databases, or installing a malicious package) by implementing fixes or making contingency plans for when the same issue might occur again. What is more challenging are the unknown unknowns: the unseen failure modes that haven't surfaced during testing. The decision to stop testing and deploy therefore faces an inherent tradeoff: continue testing to observe more behaviors, at the cost of time and resources, or stop testing and deploy, at…