Fokker-Planck analysis and invariant laws for a continuous-time stochastic model inspired by Adam
We study a degenerate stochastic system inspired by bias-corrected Adam. The system arises as the continuous-time limit of an explicitly modified recursion in which the squared-gradient update is replaced by a prescribed second-moment closure. We construct an entrance solution at the singular initial time and prove convergence of the modified recursion on finite time intervals away from zero. Bias correction enters through time-dependent coefficients which converge to constants as time tends to infinity. For a smooth objective with globally Lipschitz gradient and radial dissipativity at…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2604.00840
curl -X POST /api/v1/records/arxiv/2604.00840/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2604.00840/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'