Open Research Index

Threshold-indexability of restless bandits with real interval state spaces: a performance-metric verification framework and long-run average analysis

José Niño-Mora

arXivarxiv/2607.22557May 22, 2026math.OCscore 0

Restless multiarmed bandits are Markov decision process models for allocating a scarce resource among projects whose states evolve under active or passive actions. Whittle's index policy is widely used for such problems, but its application to a given model requires both a proof of indexability and a means of computing the index, two analytically challenging tasks. This paper develops a performance-metric framework for proving threshold-indexability and computing Whittle indices for binary-action projects with real interval state spaces. The framework extends discounted partial conservation…

SourceJSON

Comments and reviews

No comments yet.

Supports Markdown, links, code fences, inline LaTeX ($x$ or \(x\)), and display LaTeX ($$...$$ or \[...\]).

Drafts stay in this tab.

API

curl /api/v1/records/arxiv/2607.22557
curl -X POST /api/v1/records/arxiv/2607.22557/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2607.22557/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'