Drivers’ Visual Behavior-Guided RRT Motion Planner for Autonomous On-Road Driving

Mingbo Du, Tao Mei, Huawei Liang, Jiajia Chen, Rulin Huang, Pan ZhaoSensors 2016 · DOI

TL;DR

This paper introduces a novel motion planning algorithm for autonomous vehicles that leverages human drivers' visual search behavior to generate more natural and efficient trajectories. By guiding the RRT (Rapidly-exploring Random Tree) sampling process with "near" and "far" visual fixation points, the system achieves smoother, safer, and faster path planning compared to traditional RRT methods.

What Problem Does This Paper Address?

Autonomous driving systems rely heavily on motion planning to navigate safely and efficiently. Traditional motion planning algorithms, particularly sampling-based methods like RRT, often struggle with generating natural-looking, smooth trajectories for vehicles. This can lead to jerky movements, unnecessary turns, and paths that are too close to road boundaries, potentially compromising safety and passenger comfort. Furthermore, RRT's random sampling can be inefficient, leading to slow exploration and increased computation time. The challenge is to develop a motion planner that not only avoids obstacles and adheres to vehicle dynamics but also mimics human driving behavior for improved performance and acceptance.

Methods

The core of this work is a modified RRT algorithm, termed DV-RRT (Drivers' Visual Behavior-guided RRT). The key innovations are:

  • Driver's Visual Behavior Guidance: The algorithm incorporates insights from human driving research, specifically the concept of "near" and "far" visual fixation points. The "near" point is typically the center of the current lane ahead, while the "far" point is a salient feature like a vanishing point or a lead vehicle. These points are used to bias the RRT's sampling process, directing it towards more relevant and human-like areas of the state space.
  • Hybrid Sampling Strategy: Instead of purely random sampling, DV-RRT employs a "biased" sampling strategy using Gaussian distributions centered around the "near" and "far" points. This significantly reduces the generation of useless samples and accelerates exploration.
  • Reasonable Metric Function: To favor smoother paths over shorter ones, a custom metric function is introduced that considers both the Euclidean distance and the turning angle between nodes. This encourages the planner to generate paths that are more amenable to vehicle control.
  • B-Spline Post-Processing: To further enhance smoothness and ensure curvature continuity, a post-processing step using B-spline curves is applied to the generated RRT path. This refines the trajectory into a smooth, executable path.

Datasets

Not discussed in the paper. The experiments were conducted on a real autonomous vehicle platform ("Intelligent Pioneer II") in various real-world traffic scenarios.

Key Insights and Ideas

  • Human-like Vision for Planning: Mimicking human visual attention (near/far points) is a powerful way to guide motion planning, leading to more intuitive and efficient trajectories.
  • Biased Sampling is Key: Purely random sampling in RRT is inefficient for structured environments like roads. Guiding the sampling with domain-specific information (like visual cues) dramatically improves performance.
  • Smoothness Matters for Control: Trajectory smoothness is not just about comfort; it's crucial for the vehicle's low-level control systems to execute the planned path accurately and stably.
  • RRT's Potential with Guidance: RRT, despite its limitations, is a strong foundation for motion planning. With appropriate guidance and post-processing, it can be made highly effective for complex tasks like autonomous driving.

Key Results

The DV-RRT algorithm demonstrated significant improvements over basic RRT and Bi-RRT in various traffic scenarios:

  • Efficiency: DV-RRT achieved an average running time of less than 90 ms, showing a substantial speedup (4.16x over basic RRT, 2.39x over Bi-RRT).
  • Trajectory Quality:
    • Smoother Paths: DV-RRT generated trajectories with significantly lower maximum curvature, often approaching zero for straight sections, indicating much smoother paths.
  • Shorter Paths: The average path length was also reduced compared to other methods.
  • More Natural Trajectories: Qualitative results showed DV-RRT producing trajectories that closely resemble human driving, avoiding unnecessary turns and staying within lane boundaries.
  • Feasibility: The algorithm successfully planned smooth and feasible trajectories in complex scenarios, including lane changes around parked cars and car-following situations.

Limitations and Future Work

  • Limitations: The current method relies on clear lane markings and road boundaries for accurate guidance. In unstructured environments without such cues (e.g., rural roads), its performance may degrade due to a lack of accurate guidance information.
  • Future Work:
    • Extend the approach to unstructured environments by using visual information from tire tracks and pedestrian footsteps.
  • Develop a cognitive environment model based on the driver's perspective and visual selective attention mechanisms.
  • Apply the algorithm to off-road driving scenarios.
  • Further investigate multi-sensor information fusion (stereo cameras and laser radar) to enhance sensing capability and intelligence.

Summary updated

Abstract

This paper describes a real-time motion planner based on the drivers' visual behavior-guided rapidly exploring random tree (RRT) approach, which is applicable to on-road driving of autonomous vehicles. The primary novelty is in the use of the guidance of drivers' visual search behavior in the framework of RRT motion planner. RRT is an incremental sampling-based method that is widely used to solve the robotic motion planning problems. However, RRT is often unreliable in a number of practical applications such as autonomous vehicles used for on-road driving because of the unnatural trajectory, useless sampling, and slow exploration. To address these problems, we present an interesting RRT algorithm that introduces an effective guided sampling strategy based on the drivers' visual search behavior on road and a continuous-curvature smooth method based on B-spline. The proposed algorithm is implemented on a real autonomous vehicle and verified against several different traffic scenarios. A large number of the experimental results demonstrate that our algorithm is feasible and efficient for on-road autonomous driving. Furthermore, the comparative test and statistical analyses illustrate that its excellent performance is superior to other previous algorithms.
BibTeX
@inproceedings{du2016drivers,
  author = {Mingbo Du and Tao Mei and Huawei Liang and Jiajia Chen and Rulin Huang and Pan Zhao},
  title = {{Drivers’ Visual Behavior-Guided RRT Motion Planner for Autonomous On-Road Driving}},
  booktitle = {Sensors},
  year = {2016},
  doi = {10.3390/s16010102},
}
Figure