Hidden-Mode Markov Decision Processes for Nonstationary Sequential Decision Making

Samuel P. M. Choi, Dit-Yan Yeung, Nevin Lianwen Zhang

Abstract

Problem formulation is often an important first step for solving a problem effectively. In sequential decision problems, Markov decision process (MDP) ([2]; [22]) is a model formulation that has been commonly used, due to its generality, flexibility, and applicability to a wide range of problems. Despite these advantages, there are three necessary conditions that must be satisfied before the MDP model can be applied; that is,
BibTeX
@inproceedings{choi2001hidden,
  author = {Samuel P. M. Choi and Dit-Yan Yeung and Nevin Lianwen Zhang},
  title = {{Hidden-Mode Markov Decision Processes for Nonstationary Sequential Decision Making}},
  booktitle = {Sequence Learning},
  year = {2001},
  doi = {10.1007/3-540-44565-x\_12},
}

Loading related content...

Figure