Enhancing visual perception of shape through tactile glances

Mårten Björkman, Yasemin Bekiroglu, Virgile Hogman, Danica Kragic

Abstract

Object shape information is an important parameter in robot grasping tasks. However, it may be difficult to obtain accurate models of novel objects due to incomplete and noisy sensory measurements. In addition, object shape may change due to frequent interaction with the object (cereal boxes, etc). In this paper, we present a probabilistic approach for learning object models based on visual and tactile perception through physical interaction with an object. Our robot explores unknown objects by touching them strategically at parts that are uncertain in terms of shape. The robot starts by using only visual features to form an initial hypothesis about the object shape, then gradually adds tactile measurements to refine the object model. Our experiments involve ten objects of varying shapes and sizes in a real setup. The results show that our method is capable of choosing a small number of touches to construct object models similar to real object shapes and to determine similarities among acquired models.
BibTeX
@inproceedings{bjorkman2013enhancing,
  author = {Mårten Björkman and Yasemin Bekiroglu and Virgile Hogman and Danica Kragic},
  title = {{Enhancing visual perception of shape through tactile glances}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2013},
  doi = {10.1109/iros.2013.6696808},
}

Loading related content...

Figure