{"id":"arxiv/2607.08984","url":"https://arxiv.org/abs/2607.08984","tags":["cs.LG","cs.AI","cs.GT","math.CO"],"score":0,"title":"AlphaZero in Sparsely Rewarded Games: Limits and Auxiliary Supervision","domain":"cs.LG","source":"arxiv","authors":["Brent Kong","Tejas Ram","Tony Yue Yu"],"reviews":0,"subject":"cs.LG","summary":"AlphaZero has demonstrated that a neural-guided Monte Carlo Tree Search can achieve superhuman performance, but strong play does not necessarily imply perfect play. We study this gap in two oracle-evaluable domains with contrasting structure: Connect Four, a solved partisan game with exact game-theoretic values, and Chomp, an impartial game whose optimal play is governed by Grundy-number structure. Under a unified self-play $+$ MCTS pipeline, we compare vanilla AlphaZero, a multi-frame variant (limited to Chomp), and an AlphaZero Auxiliary Loss (AZAL) that adds oracle-derived policy…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-09","reactions":{}}