Motion Planning Diffusion: Learning and Planning of Robot Motions with Diffusion Models

João Carvalho, An T. Le, Mark Baierl, Dorothea Koert, Jan Peters

Abstract

Motion Planning Diffusion (MPD) is a novel framework that integrates diffusion-based generative modeling with cost-guided inference to solve complex robot motion planning tasks. By learning high-dimensional trajectory priors from expert demonstrations, MPD generates smooth, multimodal, and collision-free paths. Unlike traditional methods, MPD generalizes effectively to novel environments with unseen obstacles by leveraging real-time differentiable cost gradients during the denoising process.

Introduction

Robot motion planning—the process of finding a smooth, collision-free path between two configurations—remains a fundamental challenge in robotics. Traditional approaches typically fall into two categories: sampling-based planners and optimization-based planners. Sampling-based methods, such as RRT, are robust but often yield inefficient, jerky trajectories. Conversely, optimization-based methods produce smooth paths but are highly susceptible to local minima; a poor initial guess can lead to mathematical dead-ends where the path remains stuck in an obstacle.

While recent research has explored using machine learning to provide better priors for optimizers, standard generative models like Conditional Variational Autoencoders (CVAEs) often fail to capture the multimodality of motion planning—the existence of multiple distinct, valid paths for a single task. This paper introduces Motion Planning Diffusion (MPD) to address these limitations by reframing planning as a guided inference process.

Methodology

MPD treats motion planning as a "planning-as-inference" problem, utilizing the strengths of diffusion models to generate high-quality trajectories.

1. Learning the Trajectory Prior

The system is trained on a dataset of expert trajectories using a temporal U-Net architecture. This model learns the underlying distribution of valid robot motions, capturing the complex, multimodal nature of expert behavior.

2. Guided Denoising

During inference, MPD employs a reverse diffusion process to transform Gaussian noise into a structured trajectory. Rather than simple sampling, MPD injects "guidance" at each denoising step.

3. Differentiable Cost Integration

By utilizing the gradients of standard motion planning costs—including collision avoidance, joint limits, and smoothness—MPD nudges the denoising process toward feasible regions. This allows the model to adapt its learned prior to the specific geometry of a new environment in real-time, effectively merging generative sampling and optimization into a single, cohesive loop.

Experimental Evaluation

The researchers evaluated MPD across several simulated and real-world benchmarks designed to test both performance and generalization:

  • PointMass2D Dense: A navigation task through a dense field of random obstacles.
  • PointMass3D Maze Boxes: Navigation through narrow 3D passages.
  • Panda Spheres & Shelf: A 7-degree-of-freedom (7-DOF) Franka Emika Panda arm navigating around spheres and within a realistic shelf environment.
The PointMass2D Dense benchmark environment, featuring a point mass navigating a space filled with diverse obstacles.

To rigorously test generalization, "Extra Obstacles" variants were created, introducing objects that were entirely absent from the training data.

Key Results and Insights

Superior Multimodality and Generalization

Diffusion models proved significantly more capable than CVAEs at representing multiple distinct paths. While CVAEs often average different paths—resulting in trajectories that collide with central obstacles—MPD successfully distinguishes between disparate valid routes (e.g., "going left" vs. "going right"). Furthermore, because the guidance uses real-time cost gradients, MPD demonstrates zero-shot generalization to unseen obstacles.

Quantitative Performance

  • Success Rates: In the dense 2D environment, MPD achieved a 99% success rate, compared to just 46% for the CVAE baseline.
  • Robustness: In the "Panda Spheres - Extra Obstacles" test, MPD maintained a 93% success rate, while the CVAE-based approach dropped to 45%.
  • Real-World Deployment: MPD was successfully deployed on a physical Panda robot for shelf-clearing tasks. It generated 19/25 successful collision-free trajectories in environments with novel obstacles without any fine-tuning.
A physical Franka Emika Panda robot executing a smooth, collision-free trajectory generated by the MPD framework.

Conclusion and Future Work

Motion Planning Diffusion demonstrates that merging generative priors with cost-based guidance is a powerful paradigm for robot motion planning. While highly effective, the authors note that real-world failures can still occur due to simplified collision models (e.g., sphere-based approximations of the robot body). Future work will focus on more complex trajectory parametrizations, non-differentiable constraints, and further optimizing the computational efficiency of the diffusion process.

Summary updated

Abstract

Learning priors on trajectory distributions can help accelerate robot motion planning optimization. Given previously successful plans, learning trajectory generative models as priors for a new planning problem is highly desirable. Prior works propose several ways on utilizing this prior to bootstrapping the motion planning problem. Either sampling the prior for initializations or using the prior distribution in a maximum-a-posterior formulation for trajectory optimization. In this work, we propose learning diffusion models as priors. We then can sample directly from the posterior trajectory distribution conditioned on task goals, by leveraging the inverse denoising process of diffusion models. Furthermore, diffusion has been recently shown to effectively encode data multi-modality in high-dimensional settings, which is particularly well-suited for large trajectory dataset. To demonstrate our method efficacy, we compare our proposed method - Motion Planning Diffusion - against several baselines in simulated planar robot and 7-dof robot arm manipulator environments. To assess the generalization capabilities of our method, we test it in environments with previously unseen obstacles. Our experiments show that diffusion models are strong priors to encode high-dimensional trajectory distributions of robot motions. https://sites.google.com/view/mp-diffusion
BibTeX
@inproceedings{carvalho2023motion,
  author = {João Carvalho and An T. Le and Mark Baierl and Dorothea Koert and Jan Peters},
  title = {{Motion Planning Diffusion: Learning and Planning of Robot Motions with Diffusion Models}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2023},
  doi = {10.1109/iros55552.2023.10342382},
}
Figure