Strategies for multi-modal scene exploration

Jeannette Bohg, Matthew Johnson-Roberson, Mårten Björkman, Danica Kragic

Abstract

We propose a method for multi-modal scene exploration where initial object hypothesis formed by active visual segmentation are confirmed and augmented through haptic exploration with a robotic arm. We update the current belief about the state of the map with the detection results and predict yet unknown parts of the map with a Gaussian Process. We show that through the integration of different sensor modalities, we achieve a more complete scene model. We also show that the prediction of the scene structure leads to a valid scene representation even if the map is not fully traversed. Furthermore, we propose different exploration strategies and evaluate them both in simulation and on our robotic platform.
BibTeX
@inproceedings{bohg2010strategies,
  author = {Jeannette Bohg and Matthew Johnson-Roberson and Mårten Björkman and Danica Kragic},
  title = {{Strategies for multi-modal scene exploration}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2010},
  doi = {10.1109/iros.2010.5652967},
}

Loading related content...

Figure