{"id":"arxiv/2609.19905","url":"https://arxiv.org/abs/2609.19905","tags":["math.OC","math.PR"],"score":0,"title":"Percolation Markov Decision Processes","domain":"math.OC","source":"arxiv","authors":["Melissa González García","Guillaume Vigeral"],"reviews":0,"subject":"math.OC","summary":"We study Percolation Markov Decision Processes (PMDPs), in which the decision maker repeatedly moves a token through the d-dimensional integer lattice with deterministic transitions and random payoffs assigned to the edges. Payoffs are revealed before the beginning of the decision process and the decision maker aims to maximize the average accumulated payoff over a fixed horizon. We establish the existence of the uniform value (as the horizon tends to infinity) and 0-optimal strategies. In the particular case of Bernoulli payoffs, we establish continuity results for the uniform value. We…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-09-17","reactions":{}}