Online Trajectory Planning Through Combined Trajectory Optimization and Function Approximation: Application to the Exoskeleton Atalante

Alexis Duburcq, Yann Chevaleyre, Nicolas Bredèche, Guilhem Boéris

TL;DR

This paper introduces Guided Trajectory Learning (GTL), a novel algorithm that bridges the gap between slow, high-fidelity trajectory optimization and fast, real-time execution. By using a consensus optimization framework (ADMM), GTL forces a robot's trajectory optimizer to find solutions that a neural network can easily represent, enabling stable, real-time walking for the self-balancing Atalante exoskeleton.

What Problem Does This Paper Address?

In robotics, there is a classic tension between optimality and speed.

To make a complex robot like a bipedal exoskeleton walk safely, engineers use "trajectory optimization"—mathematical solvers that find the best path while respecting physics and hardware limits. However, these solvers are computationally "heavy" and often fail to run in real-time (online).

A common workaround is to pre-calculate thousands of trajectories offline and train a neural network to mimic them (regression). The problem? Standard neural networks often "hallucinate" slightly infeasible paths. For a human in an exoskeleton, a 1-degree error in an ankle joint isn't just a statistic; it’s a potential fall. This paper addresses the feasibility gap: how do we ensure a fast, learned model actually produces trajectories that the robot can physically execute?

Methods

The authors propose Guided Trajectory Learning (GTL). Instead of just training a model on a fixed database of "perfect" trajectories, GTL treats the problem as a consensus optimization.

  1. The Algorithm (ADMM): They use the Alternating Direction Method of Multipliers (ADMM). This is an iterative process where the trajectory optimizer and the neural network "negotiate." If the neural network struggles to learn a specific movement, the optimizer is "guided" to find a different, slightly different solution for that task that is easier for the network to represent.
  2. Function Approximation: They utilize a Deconvolutional Neural Network. Unlike standard feedforward or recurrent networks, this architecture is specifically designed to generate multi-dimensional temporal sequences (like the 12-joint angles of a walking gait) from low-dimensional task descriptions.
  3. GTL-0: For practical deployment, they highlight a simplified version called GTL-0, which focuses on the penalized reconstruction cost, making it easier to scale across large computing clusters.

Datasets

The study uses a custom-generated dataset tailored to the Atalante exoskeleton:

  • Task Space: A 12-dimensional space encompassing patient morphology (height, weight), exoskeleton mechanical settings (thigh/shank lengths), and gait parameters (step length, duration).
  • Scale: 70,000 uniformly sampled tasks.
  • Evaluation: Validated through simulation and real-world clinical trials with 6 human subjects of varying body types.

Key Insights and Ideas

  • Adapting the Data to the Model: The most profound insight is that we shouldn't just try to make models smarter; we should make the "expert" (the optimizer) more flexible. By forcing the optimizer to output "learnable" trajectories, the resulting neural network becomes significantly more reliable.
  • The Continuity Fix: Standard optimization often produces "discontinuous" solutions—small changes in a task (like step length) might lead to a completely different leg movement. GTL smooths these out, ensuring that the robot's behavior changes predictably as the environment changes.
  • Fast Convergence: Surprisingly, the GTL-0 algorithm often achieves "continuity" and high accuracy in as few as two iterations, making it highly efficient for training.

Key Results

  • Accuracy: Standard regression failed to meet the "stability criterion" (error < 0.01 rad) in over 50% of test cases. GTL-0 reduced this failure rate to just 10.5%.
  • Real-World Stability: In clinical trials, trajectories generated by standard regression were often unstable on real hardware. In contrast, GTL-0 allowed the Atalante exoskeleton to successfully control average velocity across 6 different human subjects, with measured velocities closely matching the desired inputs.
  • Computational Efficiency: Once trained, the neural network generates trajectories at a "fraction of the cost" of the original optimization, enabling true online planning.

Limitations and Future Work

  • The Reality Gap: While GTL handles the "representation gap" well, it doesn't explicitly model the "reality gap" (the difference between a simulation and the real world), though the authors note that robust low-level controllers help mitigate this.
  • GTL vs. GTL-0: The paper primarily evaluates GTL-0 for practical reasons. The full GTL (with dual multipliers) might offer even higher accuracy but requires more storage and complex implementation.
  • Future Directions: The authors suggest applying GTL to more dynamic scenarios, such as perturbation recovery (stumble recovery) and path replanning in cluttered environments. They also propose "adaptive" neural network architectures that could evolve during the GTL process.

Summary updated

Abstract

Autonomous robots require online trajectory planning capability to operate in the real world. Efficient offline trajectory planning methods already exist, but are computationally demanding, preventing their use online. In this paper, we present a novel algorithm called Guided Trajectory Learning that learns a function approximation of solutions computed through trajectory optimization while ensuring accurate and reliable predictions. This function approximation is then used online to generate trajectories. This algorithm is designed to be easy to implement, and practical since it does not require massive computing power. It is readily applicable to any robotics systems and effortless to set up on real hardware since robust control strategies are usually already available. We demonstrate the computational performance of our algorithm on flat-foot walking with the self-balanced exoskeleton Atalante.
BibTeX
@inproceedings{duburcq2020online,
  author = {Alexis Duburcq and Yann Chevaleyre and Nicolas Bredèche and Guilhem Boéris},
  title = {{Online Trajectory Planning Through Combined Trajectory Optimization and Function Approximation: Application to the Exoskeleton Atalante}},
  booktitle = {IEEE International Conference on Robotics and Automation},
  year = {2020},
  url = {https://openreview.net/forum?id=bEm6FTaqmR},
}

Loading related content...

Figure