A new policy iteration scheme for Markov decision processes using Schweitzer's formula

Jean B. LasserreJournal of Applied Probability 1994 · DOI

Abstract

Given a family of Markov chains with a single recurrent class, we present a potential application of Schweitzer's exact formula relating the steady-state probability and fundamental matrices of any two chains in the family. We propose a new policy iteration scheme for Markov decision processes where in contrast to policy iteration, the new criterion for selecting an action ensures the maximal one-step average cost improvement. Its computational complexity and storage requirement are analysed.
BibTeX
@article{lasserre1994new,
  author = {Jean B. Lasserre},
  title = {{A new policy iteration scheme for Markov decision processes using Schweitzer's formula}},
  journal = {Journal of Applied Probability},
  year = {1994},
  doi = {10.1017/s0021900200107521},
}

Loading related content...

Figure