{"id":"arxiv/2603.12636","url":"https://arxiv.org/abs/2603.12636","tags":["math.OC","cs.LG"],"score":0,"title":"Weakly Time-Coupled Approximation of Markov Decision Processes","domain":"math.OC","source":"arxiv","authors":["Negar Soheili","Selvaprabu Nadarajah","Bo Yang"],"reviews":0,"subject":"math.OC","summary":"Finite-horizon Markov decision processes (MDPs) with high-dimensional exogenous uncertainty and endogenous states arise in operations and finance, including the valuation and exercise of Bermudan and real options, but face a scalability barrier as computational complexity grows with the horizon. A common approximation represents the value function using basis functions, but methods for fitting weights treat cross-stage optimization differently. Least squares Monte Carlo (LSM) fits weights via backward recursion and regression, avoiding joint optimization but accumulating error over the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-03-13","reactions":{}}