{"id":"arxiv/2605.28983","url":"https://arxiv.org/abs/2605.28983","tags":["cs.LG","cs.AI","math.DS","math.RT","physics.comp-ph"],"score":0,"title":"The Hamilton-Jacobi Theory of Deep Learning","domain":"cs.LG","source":"arxiv","authors":["Jose Marie Antonio Miñoza","Erika Fille T. Legara","Christopher P. Monterola"],"reviews":0,"subject":"cs.LG","summary":"In this paper, training a neural network is identified, exactly, as a search through Hamilton--Jacobi initial-value problems: each gradient step selects the initial data of a viscous Hamilton--Jacobi equation whose Hopf--Cole propagator best fits the observations; at inference, the input is the spatial point at which that solution is evaluated and the initial condition is already encoded in the weights. The correspondence is exact for log-sum-exp layers, with ReLU, sigmoid, SiLU, and GELU each an exact limit, gradient, or moment of the same object, and exact in composition across depth and…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-27","reactions":{}}