A limit theorem for Markov decision processes

Mathias Staudigl

Abstract

In this paper I prove a deterministic approximation theorem for a sequence of Markov decision processes with finitely many actions and general state spaces as they appear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty assumptions are imposed on the value function.
BibTeX
@article{staudigl2014limit,
  author = {Mathias Staudigl},
  title = {{A limit theorem for Markov decision processes}},
  journal = {Journal of Dynamics and Games},
  year = {2014},
  doi = {10.3934/jdg.2014.1.639},
}

Loading related content...

Figure