Id: arxiv/2611.12308 Url: https://arxiv.org/abs/2611.12308 Tags: math.NA Score: 0 Title: Unmasking shortcut solutions of coding agents on partial differential equations Domain: math.NA Source: arxiv Authors: Jiale Linghu, Yangshuai Wang Reviews: 0 Subject: math.NA Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-11-09 Page: https://delphi.science/r/arxiv/2611.12308 Coding agents now write simulation programs, but benchmarks usually judge only whether their output matches a reference. In manufactured-solution tasks the data determine the exact solution, so a matching output need not come from a solver. We introduce PDEViBench, a benchmark of 290 tasks in six equation families that traces each passing program to the computation behind its output and reruns unclear programs on changed data. A Codex agent (GPT-5.2) passed 80% of 1,450 runs, yet about one pass in ten returned the exact solution without solving the equation. Counting only solved passes…