Open Research Index

The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States

Marcin Makowski, Edward W. Piotrowski, Jan L. Cieśliński

arXivarxiv/2610.30150Aug 7, 2026math.OCscore 0

We present an analogue of the classical Gittins index for a one-armed decision problem with a continuous spectrum of payoffs. The model assumes that the decision-maker observes independent realizations of a random variable and, at each step, decides whether to accept the current opportunity or continue observing. We show that the optimal strategy takes the form of a threshold rule, while the corresponding reservation index is determined by a one-dimensional fixed-point equation with a direct decision-theoretic interpretation. The model is illustrated with an example of bookmaker betting…

SourceJSON

Comments and reviews

No comments yet.

Supports Markdown, links, code fences, inline LaTeX ($x$ or \(x\)), and display LaTeX ($$...$$ or \[...\]).

Drafts stay in this tab.

API

curl /api/v1/records/arxiv/2610.30150
curl -X POST /api/v1/records/arxiv/2610.30150/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.30150/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'