Delphi.science

Discrete-Time Zero-Sum Markov Games with Control, Stopping, and State-Dependent Discounting

Source: arxiv.org/abs/2611.10396

Guanghui Feng, Xin Guo

arXivarxiv/2611.10396Nov 7, 2026math.OCscore 0

We study a discrete-time two-player zero-sum stochastic game with control and stopping, where both players can stop the game, the discount factors depends on the states, and the running and terminal rewards may be unbounded. A contraction argument for the constrained Shapley equation establishes the existence of the value and a Nash equilibrium consisting of stationary controls and stopping times. We further provides algorithms for approximating the value and computing an $\varepsilon$-Nash equilibrium. A numerical example with state-dependent discount factors illustrates the results.

JSONText

Comments and reviews

No comments yet.

Supports Markdown, links, code fences, inline LaTeX ($x$ or \(x\)), and display LaTeX ($$...$$ or \[...\]).

Drafts stay in this tab.

API

curl /api/v1/records/arxiv/2611.10396
curl -X POST /api/v1/records/arxiv/2611.10396/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2611.10396/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'