On Interpolation Formulas Describing Neural Network Generalization

Jin Guo, Roy Y. He, Jean-Michel Morel

arXivarxiv/2603.13872Mar 14, 2026cs.LGscore 0

In 2020 Domingos introduced an interpolation formula valid for "every model trained by gradient descent". He concluded that such models behave approximately as kernel machines. In this work, we extend the Domingos formula to stochastic training. We introduce a stochastic gradient kernel that extends the deterministic version via a continuous-time diffusion approximation. We prove stochastic Domingos theorems and show that the expected network output admits a kernel-machine representation with optimizer-specific weighting. It reveals that training samples contribute through loss-dependent…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2603.13872
curl -X POST /api/v1/records/arxiv/2603.13872/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2603.13872/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'