Stress-Testing Neural Network Verifiers with Provably Robust Instances

David Troxell, Yulia Alexandr, Sofia Hunt, Stephanie Lei, Guido Montúfar

arXivarxiv/2605.17153May 16, 2026cs.LGscore 0

Neural network verifiers aim to provide formal guarantees on model behavior, but existing verification benchmarks are fundamentally limited by their lack of ground-truth labels. As a result, verifier evaluation relies on indirect heuristics, which prevents exact scoring and systematic study of verifier failure modes. We address this gap by introducing a reusable framework for generating verification instances whose ground-truth robustness labels are known a priori through analytic construction. Our framework led to the discovery of multiple numeric tolerance concerns and an implementation…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2605.17153
curl -X POST /api/v1/records/arxiv/2605.17153/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2605.17153/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'