A Novel Learning Framework for Sampling-Based Motion Planning in Autonomous Driving

Yifan Zhang, Jinghuai Zhang, Jindi Zhang, Jianping Wang, Kejie Lu, L. Jeff Hong

Introduction

Motion planning is the critical "brain" of an autonomous vehicle, responsible for determining safe, collision-free paths in dynamic environments. While Sampling-Based Motion Planning (SBMP) is a popular choice due to its efficiency in high-dimensional spaces, it often faces a difficult trade-off between real-time performance and trajectory quality. Standard planners may sample too few points to meet strict 100ms sensor update cycles, resulting in "jerky" movements that are uncomfortable for passengers and unpredictable for other road users. Furthermore, traditional planners often struggle to anticipate the future intentions of surrounding vehicles, leading to reactive maneuvers rather than proactive, smooth driving.

This paper introduces a novel learning-based framework that addresses these challenges by "seeing" into the future. By combining a two-stage intention prediction model with a Conditional Variational Autoencoder (CVAE) that mimics human driving, the system focuses its search on high-quality trajectories, outperforming traditional sampling methods in both safety and passenger comfort.

System Architecture

The proposed framework integrates prediction and imitation learning directly into the motion planning loop. It consists of three primary components: a Prediction Module that analyzes surrounding traffic, a Sampling Module that generates human-like candidate points, and a Planning Module that selects the optimal trajectory.

Figure 1: Overview of the proposed motion planning framework.

Methodology

The researchers propose a three-part methodology to overcome the limitations of traditional SBMP.

Novel Automatic Labeling

To train high-performance models, the quality of the training data is paramount. The authors developed a geometric labeling scheme to identify the exact start and end points of lane changes. Unlike previous methods that relied on simple time-based or velocity-based thresholds, this geometric approach accurately captures the vehicle's spatial relationship with lane boundaries, providing a cleaner dataset for the prediction models.

Two-Stage Intention Prediction

A key innovation of this work is the two-stage intention prediction model. Instead of a single model for all scenarios, the system uses two separate Long Short-Term Memory (LSTM) architectures:

  • Stage 1: Handles regular car-following behavior and the lead-up to a lane change.
  • Stage 2: Takes over the moment a vehicle's tire crosses a lane line.

This bifurcation is based on the insight that vehicle behavior changes significantly the moment a maneuver begins. By splitting the task, the framework achieves much higher reliability during the most critical moments of a lane change compared to baseline models like Social-LSTM.

Figure 3: The training and testing pipeline for the two-stage intention prediction model.

CVAE-based Imitation Learning

To improve the quality of sampled paths, the framework uses a Conditional Variational Autoencoder (CVAE) to learn the "distribution" of human driving. The model processes a 3D occupancy grid representing the environment and generates sample points that mimic where a human driver would likely go. This "biases" the SBMP algorithm to search in high-probability, smooth areas rather than wasting computational resources on erratic or impossible paths. This approach effectively uses imitation as a bias, avoiding the "robotic" feel of traditional mathematical sampling.

Experimental Setup and Datasets

The framework was trained and evaluated using two gold-standard public datasets: NGSIM US-101 (Los Angeles highway data) and NGSIM I-80 (Emeryville highway data). These high-resolution trajectory datasets provided the necessary ground truth for training the intention prediction LSTMs and teaching the CVAE the nuances of human-like driving.

Key Results and Insights

The proposed framework demonstrated significant improvements over traditional biased sampling methods:

  • Higher Success Rates: At a tight 200ms replanning interval, the method achieved a 100% success rate in finding valid paths, whereas standard Gaussian-biased methods succeeded only 70% of the time.
  • Faster Computation: Average planning time was reduced to 136ms, a significant improvement over the 196ms required by traditional methods.
  • Superior Smoothness: The generated trajectories had significantly lower acceleration variation (less "jerk"), leading to a more comfortable passenger experience.
  • Proactive Safety: By accurately predicting if a neighboring vehicle is about to cut in, the planner gains a "longer time window." This allows the vehicle to calculate a smooth deceleration or lane change proactively, rather than reacting abruptly.

Conclusion and Future Work

This research highlights the power of combining prediction and imitation learning to solve complex motion planning problems. While the results on highway datasets are promising, several areas remain for future exploration. The current 3D occupancy grid approach may face scaling challenges in extremely dense urban environments with hundreds of agents. Future work will focus on validating the framework in complex intersections and unstructured environments, as well as dynamically tuning parameters to account for varying driving cultures and weather conditions.

Summary updated

Abstract

Sampling-based motion planning (SBMP) is a major trajectory planning approach in autonomous driving given its high efficiency in practice. As the core of SBMP schemes, sampling strategy holds the key to whether a smooth and collision-free trajectory can be found in real-time. Although some bias sampling strategies have been explored in the literature to accelerate SBMP, the trajectory generated under existing bias sampling strategies may lead to sharp lane changing. To address this issue, we propose a new learning framework for SBMP. Specifically, we develop a novel automatic labeling scheme and a 2-Stage prediction model to improve the accuracy in predicting the intention of surrounding vehicles. We then develop an imitation learning scheme to generate sample points based on the experience of human drivers. Using the prediction results, we design a new bias sampling strategy to accelerate the SBMP algorithm by strategically selecting necessary sample points that can generate a smooth and collision-free trajectory and avoid sharp lane changing. Data-driven experiments show that the proposed sampling strategy outperforms existing sampling strategies, in terms of the computing time, traveling time, and smoothness of the trajectory. The results also show that our scheme is even better than human drivers.
BibTeX
@inproceedings{zhang2020novel,
  author = {Yifan Zhang and Jinghuai Zhang and Jindi Zhang and Jianping Wang and Kejie Lu and L. Jeff Hong},
  title = {{A Novel Learning Framework for Sampling-Based Motion Planning in Autonomous Driving}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2020},
  doi = {10.1609/aaai.v34i01.5473},
}
Figure