A limit theorem for Markov decision processes

Mathias Staudigl

Abstract

In this paper we prove a deterministic approximation theorem for a sequence of Markov decision processes with finitely many actions and general state spaces as they\nappear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty assumptions are imposed on the value\nfunction. Applications for this result can be found in large deviation theory, and some simple economic problems.
BibTeX
@article{staudigl2014limit,
  author = {Mathias Staudigl},
  title = {{A limit theorem for Markov decision processes}},
  journal = {Journal of Dynamics and Games},
  year = {2014},
  doi = {10.3934/jdg.2014.1.639},
}

Loading related content...

Figure