{"id":"arxiv/2605.17149","url":"https://arxiv.org/abs/2605.17149","tags":["math.OC","math.PR"],"score":0,"title":"QPLEX Decision Processes: Formulation via Nonlinear Markov Chains and Optimization via Policy Gradients","domain":"math.OC","source":"arxiv","authors":["Antonius B. Dieker","Steven T. Hackman","Zitong Wang","Yunhao Yan"],"reviews":0,"subject":"math.OC","summary":"We introduce a QPLEX Decision Process (QDP) as a model for dynamic control of queueing systems with non-stationary arrivals, general service distributions, and service-level chance constraints. QDPs integrate QPLEX, a computational modeling methodology for transient analysis of stochastic systems, into a nonlinear Markov decision framework. Since QPLEX approximations use nonlinear transition probabilities with orders-of-magnitude smaller state spaces, QDPs circumvent the curse of dimensionality associated with general service times. Via forward and backward iterative schemes, we can rapidly…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-05-16","reactions":{}}