Abstract
This paper introduces a framework for learning complex, multi-task robot motions from human demonstrations by combining structured Riemannian Motion Policies (RMPs) with end-to-end deep learning. By optimizing subtask policies jointly rather than independently, the system learns to balance competing objectives—such as reaching a goal while maintaining a specific orientation—while providing mathematical guarantees for motion stability.
Introduction
Teaching robots to perform complex maneuvers, such as picking an object from a cramped shelf and placing it precisely elsewhere, is challenging because these tasks involve multiple simultaneous constraints. A robot must reach a target, avoid collisions, and manage its internal joint limits simultaneously. While Learning from Demonstration (LfD) is a popular approach, standard methods often struggle with inconsistent demonstrations in joint space and the difficulty of coordinating modular subtasks.
Methodology
The proposed framework builds upon RMPflow, treating robot motion as a flow on a manifold. The key innovation lies in the use of Transform Trees and end-to-end learning to coordinate subtasks.
Transform Trees
The system uses a tree structure to map the robot's configuration space to various subtask spaces. This allows users to specify exactly which parts of the robot (e.g., gripper tips, elbow) are relevant for a specific task.
End-to-End Learning
Unlike previous work that learned subtask policies independently, this method uses a joint objective function. It differentiates through the entire motion generation process to learn the importance weights (metrics) that coordinate different subtasks. This hybrid approach allows for the mixing of learned policies with hand-designed constraints, providing both flexibility and safety. To ensure the learned policies are expressive yet stable, the authors employ:
- Diffeomorphism Networks: Mapping complex motions to a simple latent space.
- Metric Networks: Ensuring the importance of each task is mathematically well-behaved (positive definite).
Experimental Results
The approach was validated using a 7-DOF Rethink Sawyer robot and human demonstrations collected via kinesthetic teaching. The tasks included constrained inspection and multi-shelf placing.
The "Coordinated" approach significantly outperformed baselines in both accuracy and generalization. In complex placing tasks, it reduced orientation error by nearly half compared to independent learning. When starting from novel positions, the coordinated approach achieved a near 100% success rate, whereas baseline methods often dropped to 10-20%. Visualizations confirm that the model produces smooth, human-like trajectories that successfully reach the goal without getting "stuck."
Conclusion
By integrating geometric structure with deep learning, this framework enables robots to learn sophisticated coordination from human data. The use of natural gradient flow and diffeomorphisms ensures that the system is Lyapunov stable, meaning the robot will always converge to its goal without requiring extensive hand-tuning of safety parameters. Future work will focus on dynamic environments and automated structure discovery.
Summary updated