{"id":"arxiv/2604.01378","url":"https://arxiv.org/abs/2604.01378","tags":["cs.LG","math.OC"],"score":0,"title":"Residuals-based Offline Reinforcement Learning","domain":"cs.LG","source":"arxiv","authors":["Qing Zhu","Xian Yu"],"reviews":0,"subject":"cs.LG","summary":"Offline reinforcement learning (RL) has received increasing attention for learning policies from previously collected data without interaction with the real environment, which is particularly important in high-stakes applications. While a growing body of work has developed offline RL algorithms, these methods often rely on restrictive assumptions about data coverage and suffer from distribution shift. In this paper, we propose a residuals-based offline RL framework for general state and action spaces. Specifically, we define a residuals-based Bellman optimality operator that explicitly…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-01","reactions":{}}