{"id":"arxiv/2607.16538","url":"https://arxiv.org/abs/2607.16538","tags":["math.OC"],"score":0,"title":"History-Dependent Recursive Preferences in Markov Decision Processes","domain":"math.OC","source":"arxiv","authors":["William B. Haskell"],"reviews":0,"subject":"math.OC","summary":"In finite horizon dynamic programming with history-dependent preferences, the relevant state may be the entire realized history, even when the physical state is Markov. This paper develops a behavioral state-reduction theory for such Markov decision processes. Under behavioral axioms and a certainty-equivalent richness condition, the full-history problem admits a recursive representation composed of time and risk aggregators. We then derive a canonical preference-augmented (PA) state by quotienting histories that have the same current physical Markov state, are indifferent under every common…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-07-17","reactions":{}}