Feeling the force: Integrating force and pose for fluent discovery through imitation learning to open medicine bottles
Lists
Only you see this
Abstract
Learning complex robot manipulation policies for real-world objects is challenging, often requiring significant tuning within controlled environments. In this paper, we learn a manipulation model to execute tasks with multiple stages and variable structure, which typically are not suitable for most robot manipulation approaches. The model is learned from human demonstration using a tactile glove that measures both hand pose and contact forces. The tactile glove enables observation of visually latent changes in the scene, specifically the forces imposed to unlock the child-safety mechanisms of medicine bottles. From these observations, we learn an action planner through both a top-down stochastic grammar model (And-Or graph) to represent the compositional nature of the task sequence and a bottom-up discriminative model from the observed poses and forces. These two terms are combined during planning to select the next optimal action. We present a method for transferring this human-specific knowledge onto a robot platform and demonstrate that the robot can perform successful manipulations of unseen objects with similar task structure.
BibTeX
@inproceedings{edmonds2017feeling,
author = {Mark Edmonds and Feng Gao and Xu Xie and Hangxin Liu and Siyuan Qi and Yixin Zhu and Brandon Rothrock and Song-Chun Zhu},
title = {{Feeling the force: Integrating force and pose for fluent discovery through imitation learning to open medicine bottles}},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
year = {2017},
doi = {10.1109/iros.2017.8206196},
}Loading related content...