{"id":"arxiv/2605.04466","url":"https://arxiv.org/abs/2605.04466","tags":["math.OC"],"score":0,"title":"Distributed TD Tracking with Linear Function Approximation over Directed Communication Networks","domain":"math.OC","source":"arxiv","authors":["Haocheng Yang","Shengchao Zhao","Yongchao Liu"],"reviews":0,"subject":"math.OC","summary":"We study the policy evaluation problem in multi-agent reinforcement learning (MARL) over directed communication networks, where agents cooperate with each other to explore an unknown environment and accomplish a specific task. We propose a Push-Pull-type distributed algorithm, named PP-DTD, for policy evaluation in MARL within the framework of temporal difference (TD) learning with linear function approximation. PP-DTD integrates TD learning with the Push-Pull mechanism to accommodate directed communication networks, and further utilizes variance reduction techniques to enhance both…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-06","reactions":{}}