Scholion.ai

Policy Bounds for Markov Decision Processes

William S. Lovejoy

Operations Research · 1986 · Volume 34 · Issue 4

DOI: 10.1287/opre.34.4.630

Abstract

This paper demonstrates how a Markov decision process (MDP) can be approximated to generate a policy bound, i.e., a function that bounds the optimal policy from below or from above for all states. We present sufficient conditions for several computationally attractive approximations to generate rigorous policy bounds. These approximations include approximating the optimal value function, replacing the original MDP with a separable approximate MDP, and approximating a stochastic MDP with its deterministic counterpart. An example from the field of fisheries management demonstrates the practical applicability of the results.

Keywords

93 approximate models for policy bounds, 117 policy bounds for MDP's, 635 approximate models for policy bounds

Enable JavaScript for citation tools and additional paper interactions.