Journal of Applied Probability 1994

3 papers
In 1994, the Journal of Applied Probability featured research primarily focused on the theoretical and computational aspects of Markov processes. A central theme during this period was the refinement of Markov decision processes (MDPs), with specific attention given to average-cost models and the development of policy iteration schemes. Jean B. Lasserre was a notable contributor to these discussions, particularly regarding the identification of optimal and non-optimal actions within stochastic frameworks. The year’s publications also addressed the mathematical properties of Markov chains, including research into singular perturbations. Significant work involved the application of Schweitzer's formula to create new policy iteration schemes, reflecting a broader trend toward improving algorithmic efficiency in decision-making models. Collectively, these contributions advanced the understanding of how to manage and optimize complex systems governed by probabilistic transitions.

Top Authors

AuthorPapers
Jean B. Lasserre3

Papers

Title
A formula for singular perturbations of Markov chains
A new policy iteration scheme for Markov decision processes using Schweitzer's formula
Detecting optimal and non-optimal actions in average-cost Markov decision processes