Active Improvement of Control Policies with Bayesian Gaussian Mixture Model
Lists
Only you see this
Abstract
Learning from demonstration (LfD) is an intuitive framework allowing non-expert users to easily (re-)program robots. However, the quality and quantity of demonstrations have a great influence on the generalization performances of LfD approaches. In this paper, we introduce a novel active learning framework in order to improve the generalization capabilities of control policies. The proposed approach is based on the epistemic uncertainties of Bayesian Gaussian mixture models (BGMMs). We determine the new query point location by optimizing a closed-form information-density cost based on the quadratic Rényi entropy. Furthermore, to better represent uncertain regions and to avoid local optima problem, we propose to approximate the active learning cost with a Gaussian mixture model (GMM). We demonstrate our active learning framework in the context of a reaching task in a cluttered environment with an illustrative toy example and a real experiment with a Panda robot.
BibTeX
@inproceedings{girgin2020active,
author = {Hakan Girgin and Emmanuel Pignat and Noémie Jaquier and Sylvain Calinon},
title = {{Active Improvement of Control Policies with Bayesian Gaussian Mixture Model}},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
year = {2020},
doi = {10.1109/iros45743.2020.9341187},
}| Bayesian Gaussian mixture model for robotic policy imitation | arXiv · 2019 |
| Uncertainty Aware Learning from Demonstrations in Multiple Contexts using Bayesian Neural Networks | arXiv · 2019 |
| Risk-Aware Active Inverse Reinforcement Learning | arXiv · 2019 |
| Active Learning based on Data Uncertainty and Model Sensitivity | arXiv · 2018 |
| Active Fine-Tuning of Multi-Task Policies | arXiv · 2024 |
| Active Reward Learning | Robotics: Science and Systems · 2014 |