Discrete-Time Zero-Sum Markov Games with Control, Stopping, and State-Dependent Discounting
Source: arxiv.org/abs/2611.10396
We study a discrete-time two-player zero-sum stochastic game with control and stopping, where both players can stop the game, the discount factors depends on the states, and the running and terminal rewards may be unbounded. A contraction argument for the constrained Shapley equation establishes the existence of the value and a Nash equilibrium consisting of stationary controls and stopping times. We further provides algorithms for approximating the value and computing an $\varepsilon$-Nash equilibrium. A numerical example with state-dependent discount factors illustrates the results.
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2611.10396
curl -X POST /api/v1/records/arxiv/2611.10396/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2611.10396/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'