Intrinsically motivated goal exploration for active motor learning in robots: A case study

Adrien Baranes, Pierre-Yves OudeyerIROS 2010 · OpenReview

Abstract

We introduce the Self-Adaptive Goal Generation - Robust Intelligent Adaptive Curiosity (SAGG-RIAC) algorithm as an intrinsically motivated goal exploration mechanism which allows a redundant robot to efficiently and actively learn its inverse kinematics. The main idea is to push the robot to perform babbling in the goal/operational space, as opposed to motor babbling in the actuator space, by self-generating goals actively and adaptively in regions of the goal space which provide a maximal competence improvement for reaching those goals. Then, a lower level active motor learning algorithm, inspired by the SSA algorithm, is used to allow the robot to locally explore how to reach a given self-generated goal. We present simulated experiments in a 32 dimensional continuous sensorimotor space showing that 1) exploration in the goal space can be a lot faster than exploration in the actuator space for learning the inverse kinematics of a redundant robot; 2) selecting goals based on the maximal improvement heuristics is statistically significantly more efficient than selecting goals randomly.
BibTeX
@inproceedings{baranes2010intrinsically,
  author = {Adrien Baranes and Pierre-Yves Oudeyer},
  title = {{Intrinsically motivated goal exploration for active motor learning in robots: A case study}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2010},
  url = {https://openreview.net/forum?id=yC6h8v7VDM},
}

Loading related content...

Figure