Myopic Solutions of Markov Decision Processes and Stochastic Games
Operations Research · 1981 · Volume 29 · Issue 5
Abstract
Sufficient conditions are presented for a Markov decision process to have a myopic optimum and for a stochastic game to possess a myopic equilibrium point. An optimum (or an equilibrium point) is said to be “myopic” if it can be deduced from an optimum (or an equilibrium point) of a static optimization problem (or a static [Nash] game). The principal conditions are (a) each single period reward is the sum of terms due to the current state and action, (b) each transition probability depends on the action taken but not on the state from which the transition occurs, and (c) an appropriate static optimum (or equilibrium point) is ad infinitum repeatable. These conditions are satisfied by several dynamic oligopoly models and numerous Markov decision processes.
Keywords
116 myopic optima in Markov decision processes, 236 myopic equilibrium points in stochastic games
Enable JavaScript for citation tools and additional paper interactions.