{"id":"arxiv/2605.00532","url":"https://arxiv.org/abs/2605.00532","tags":["math.OC","math.NA","math.PR"],"score":0,"title":"Linking PageRank, Time Reversal, and Policy Evaluation","domain":"math.OC","source":"arxiv","authors":["Konstantin Avrachenkov","Lorenzo Gregoris","Nelly Litvak"],"reviews":0,"subject":"math.OC","summary":"We establish a connection between policy evaluation in Markov decision processes and PageRank in network analysis. For a fixed policy, we show that the value function of a discounted Markov decision process can be obtained, up to an explicit rescaling, from the PageRank vector of a suitably defined time-reversed Markov chain. In this correspondence, the discount factor plays the role of the teleportation parameter, while rewards induce the restart distribution. Beyond the irreducible case, invoking quasi-stationary distributions and Doob $h$-transforms, we prove a general decomposition…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-01","reactions":{}}