QPLEX Decision Processes: Formulation via Nonlinear Markov Chains and Optimization via Policy Gradients

Antonius B. Dieker; Steven T. Hackman; Zitong Wang; Yunhao Yan

QPLEX Decision Processes: Formulation via Nonlinear Markov Chains and Optimization via Policy Gradients

Antonius B. Dieker, Steven T. Hackman, Zitong Wang, Yunhao Yan

arXivarxiv/2605.17149May 16, 2026math.OCscore 0

We introduce a QPLEX Decision Process (QDP) as a model for dynamic control of queueing systems with non-stationary arrivals, general service distributions, and service-level chance constraints. QDPs integrate QPLEX, a computational modeling methodology for transient analysis of stochastic systems, into a nonlinear Markov decision framework. Since QPLEX approximations use nonlinear transition probabilities with orders-of-magnitude smaller state spaces, QDPs circumvent the curse of dimensionality associated with general service times. Via forward and backward iterative schemes, we can rapidly…

Source JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2605.17149
curl -X POST /api/v1/records/arxiv/2605.17149/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2605.17149/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'