Soft-Update MSA for Nonconvex Stochastic Optimal Control: Theory and Algorithms
For the method of successive approximations (MSA), a fundamental challenge is that the stochastic maximum principle (SMP) provides an optimality condition rather than a descent rule. To overcome this difficulty for nonconvex stochastic control problems, we develop a soft-update MSA (SU-MSA) with a second-order-adjoint correction of the Hamiltonian and a neural realization called DeepSMP. Both an explicit stepsize rule guaranteeing cost descent and the convergence of the algorithm are established. Moreover, the global SMP condition is asymptotically satisfied when the corrected Hamiltonian is…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2610.30585
curl -X POST /api/v1/records/arxiv/2610.30585/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.30585/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'