A formal framework for robot learning and control under model uncertainty

Robin Jaulmes, Joelle Pineau, Doina PrecupICRA 2007 · OpenReview

Abstract

While the partially observable Markov decision process (POMDP) provides a formal framework for the problem of robot control under uncertainty, it typically assumes a known and stationary model of the environment. In this paper, we study the problem of finding an optimal policy for controlling a robot in a partially observable domain, where the model is not perfectly known, and may change over time. We present an algorithm called MEDUSA which incrementally learns a POMDP model using queries, while still optimizing a reward function. We demonstrate effectiveness of the approach for a simple scenario, where a robot seeking a person has minimal a priori knowledge of its own sensor model, as well as where the person is located.
BibTeX
@inproceedings{jaulmes2007formal,
  author = {Robin Jaulmes and Joelle Pineau and Doina Precup},
  title = {{A formal framework for robot learning and control under model uncertainty}},
  booktitle = {IEEE International Conference on Robotics and Automation},
  year = {2007},
  url = {https://openreview.net/forum?id=6PZqoUk6F7i},
}

Loading related content...

Figure