Reactive Motion Generation on Learned Riemannian Manifolds

Hadi Beik-Mohammadi, Søren Hauberg, Georgios Arvanitidis, Gerhard Neumann, Leonel Rozo

Here is a concise, engaging summary of the research paper.

TL;DR

This paper introduces a reactive robot motion generation framework that bridges the gap between classic motion planning and movement primitives by learning Riemannian manifolds from human demonstrations. By modeling motion skills as geodesics (shortest paths) on these learned manifolds, the system can dynamically reshape its path to avoid obstacles on the fly while preserving the natural style of the demonstrated behavior.

What Problem Does This Paper Address?

When teaching robots new skills via Learning from Demonstration (LfD), researchers typically rely on two paradigms: classic motion planners or movement primitives.

Classic planners excel at avoiding obstacles but require a precise geometric model of the environment and must replan from scratch if something moves. Movement primitives encapsulate natural human motion patterns beautifully but struggle to adapt to unseen or dynamic obstacles without tedious retraining.

The authors tackle this trade-off, proposing a reactive motion generator that mimics human style and adapts dynamically to changing environments without requiring model retraining.

Figure 1. From demonstrations we learn a variational autoencoder that spans a random Riemannian manifold. Geodesics on this manifold are viewed as motion skills.

Methods

The core idea is to treat a robot motion skill as a smooth, curved surface—a Riemannian manifold—where the most natural movements follow geodesics (the generalization of straight lines to curved spaces).

  1. Manifold Learning via VAEs: The authors use a novel Variational Autoencoder (VAE) architecture to map high-dimensional robot states into a low-dimensional latent space. The VAE decoder's mean and variance are used to mathematically define the Riemannian metric.
  2. Handling Full Poses and Joint Spaces:
  3. For Task Space ($R^3 \times S^3$), the VAE handles positions using standard Gaussians and orientations using a mixture of antipodal von Mises-Fisher (vMF) distributions to properly account for quaternion antipodality (where $q$ and $-q$ represent the same rotation).
  4. For Joint Space ($R^\eta$), they embed an untrainable forward kinematics layer directly into the VAE. This allows the system to map joint configurations directly to task-space coordinates.
  5. Obstacle Avoidance via Metric Reshaping: To avoid obstacles, the authors dynamically alter the "ambient space metric" near an obstacle, effectively making that region of space mathematically "longer" or higher energy. This forces the calculated geodesics to naturally bend around the obstacle.
  6. Graph-Based Geodesic Computation: Instead of using gradient descent to find paths (which can get stuck in local minima), the authors discretize the low-dimensional latent space into a uniform grid graph and use Dijkstra's algorithm combined with cubic splines to compute globally optimal paths in real time.

Datasets

The approach was evaluated using:

  • Synthetic Data: A toy dataset consisting of J-shaped positions and C-shaped orientations to validate the VAE's ability to capture complex geometries and handle quaternion properties.
  • Real-Robot Demonstrations: Kinesthetic teaching data collected at 10Hz from a 7-DoF Franka Emika Panda robotic arm for two main tasks:
  • Reach-to-grasp: Approaching an object with a distinct 90-degree rotation.
  • Pouring: A multi-modal task involving grasping 3 different bottles and pouring into 3 different cups, creating a combinatorial "multiple-solution" problem space.

Key Insights and Ideas

  • Uncertainty as Boundaries: The VAE's predictive variance acts as a natural boundary for the robot's movements. Regions with no demonstration data have high variance, which translates to high Riemannian energy. As a result, geodesics are naturally incentivized to stay within the "safe" corridor of high-density human demonstrations.
  • Whole-Body Avoidance via Kinematic Pullback: By incorporating forward kinematics into the joint-space VAE, task-space obstacle data can be pulled back to influence the entire robot body. This enables multiple-limb obstacle avoidance, allowing the robot's elbows or links to dodge obstacles while the end-effector stays on task.
  • Exploiting Redundancy for Hybrid Solutions: Because the framework models the entire manifold of solutions, the robot can seamlessly transition between different demonstrated styles to form novel, hybrid trajectories on the fly (e.g., combining the beginning of one pouring demonstration with the end of another).
Comparison of geodesics in latent space: Riemannian geodesics (yellow) stay safely within the demonstration boundaries, whereas Euclidean paths (red) cut straight through unmodeled, high-uncertainty zones.

Key Results

  • Real-Time Performance: The Python implementation successfully ran at 100Hz on standard PC hardware, making it fully capable of reactive, real-time control.
  • Successful Dynamic Avoidance: In real-robot experiments, the Franka Panda successfully avoided moving obstacles in both task space and joint space while executing smooth, natural-looking reaching and pouring motions.
  • Multi-Modal Flexibility: In the pouring task, the robot successfully generated all 9 permutations of bottle-to-cup trajectories, despite only being trained on a small subset of those combinations.

Limitations and Future Work

  • The "Soft Constraint" Problem: Obstacle avoidance is currently enforced as a soft constraint (by increasing path cost). In extreme scenarios, a geodesic might still clip an obstacle if the alternative path is too costly. The authors suggest physically removing nodes from the discrete graph to enforce "hard" constraints in the future.
  • Out-of-Distribution Behavior: If an obstacle completely blocks the manifold, the geodesic is forced into high-uncertainty regions where the VAE's latent space is poorly defined, potentially leading to erratic robot behavior.
  • Scaling Discretization: The graph-based Dijkstra approach suffers from the curse of dimensionality. While highly efficient for 2D and 3D latent spaces, it will not scale well if the latent space dimensionality needs to be increased to accommodate complex perceptual inputs like camera images.

Summary updated

Abstract

In recent decades, advancements in motion learning have enabled robots to acquire new skills and adapt to unseen conditions in both structured and unstructured environments. In practice, motion learning methods capture relevant patterns and adjust them to new conditions such as dynamic obstacle avoidance or variable targets. In this paper, we investigate the robot motion learning paradigm from a Riemannian manifold perspective. We argue that Riemannian manifolds may be learned via human demonstrations in which geodesics are natural motion skills. The geodesics are generated using a learned Riemannian metric produced by our novel variational autoencoder (VAE), which is especially intended to recover full-pose end-effector states and joint space configurations. In addition, we propose a technique for facilitating on-the-fly end-effector/multiple-limb obstacle avoidance by reshaping the learned manifold using an obstacle-aware ambient metric. The motion generated using these geodesics may naturally result in multiple-solution tasks that have not been explicitly demonstrated previously. We extensively tested our approach in task space and joint space scenarios using a 7-DoF robotic manipulator. We demonstrate that our method is capable of learning and generating motion skills based on complicated motion patterns demonstrated by a human operator. Additionally, we assess several obstacle avoidance strategies and generate trajectories in multiple-mode settings.
BibTeX
@article{beikmohammadi2023reactive,
  author = {Hadi Beik-Mohammadi and Søren Hauberg and Georgios Arvanitidis and Gerhard Neumann and Leonel Rozo},
  title = {{Reactive Motion Generation on Learned Riemannian Manifolds}},
  journal = {Int. J. Robotics Res.},
  year = {2023},
  doi = {10.1177/02783649231193046},
}
Figure