{"id":"arxiv/2601.13045","url":"https://arxiv.org/abs/2601.13045","tags":["math.GM"],"score":0,"title":"Markovian restless bandits and index policies: A review","domain":"math.GM","source":"arxiv","authors":["José Niño-Mora"],"reviews":0,"subject":"math.GM","summary":"The restless multi-armed bandit problem is a paradigmatic modeling framework for optimal dynamic priority allocation in stochastic models of wide-ranging applications that has been widely investigated and applied since its inception in a seminal paper by Whittle in the late 1980s. The problem has generated a vast and fast-growing literature from which a significant sample is thematically organized and reviewed in this paper. While the main focus is on priority-index policies due to their intuitive appeal, tractability, asymptotic optimality properties, and often strong empirical performance,…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-01-19","reactions":{}}