Multi-Feature-Filtering-Based Road Curb Extraction from Unordered Point Clouds

Lang Hong, Peng Yuan, Zheng Zou, Shengxue Zhu, Yichuan Peng, Hao DuSensors 2024 · DOI

TL;DR

This paper introduces a novel multi-feature filtering method for robustly extracting road curbs from unordered 3D point clouds, a crucial task for autonomous driving. By combining several techniques, including a multi-frame fitting approach, their method significantly improves accuracy and robustness in complex urban environments compared to existing single-frame methods.

What Problem Does This Paper Address?

Accurate road curb extraction is fundamental for autonomous vehicles to understand their environment, calculate road geometry, and navigate safely. However, existing methods often struggle with "unordered" point cloud data, which lacks the structured organization of "ordered" data. This limitation makes them less effective in real-world scenarios where point clouds are often unstructured and can be cluttered with obstacles like vehicles and vegetation. Furthermore, traditional single-frame fitting methods can be prone to errors due to the limited view of a single scan. This paper aims to overcome these challenges by developing a robust method for curb extraction from unordered point clouds that is less susceptible to noise and more effective in complex road conditions.

Methods

The proposed method employs a multi-stage filtering pipeline:

  1. Grid Height Difference: The point cloud is first gridded, and the height difference within each grid is calculated. Grids with significant height variations are flagged as potentially containing curbs, effectively filtering out much of the flat ground.
  2. Normal Vector Filtering: Points whose normal vectors are not close to perpendicular to the ground plane (Z-axis) are identified. Curbs, being vertical structures, will have normal vectors oriented differently from ground points.
  3. Clustering (DBSCAN): Density-Based Spatial Clustering of Applications with Noise (DBSCAN) is used to group points. This helps to separate distinct objects (like curbs) from noise and obstacles, leveraging the fact that road edges tend to form elongated clusters.
  4. Density-Based Alpha-Shape Algorithm: An adaptive alpha-shape algorithm, which adjusts its rolling circle radius based on local point cloud density, is employed to refine the boundary extraction. This helps to capture the shape of the curb more accurately, even in areas with varying point density.
  5. Multi-Frame MSAC Fitting: This is a key innovation. Instead of fitting a model to a single frame of data, the authors use the M-Estimate Sample Consensus (MSAC) algorithm to fit a curb contour across five consecutive frames. This multi-frame approach smooths out noise and inaccuracies from individual frames, leading to a more complete and accurate representation of the curb.

Datasets

The authors utilized two datasets for their experiments:

  • Self-developed dataset: Collected using their custom-built Mobile Laser Scanning (MLS) system, featuring a Livox Horizon 3D LiDAR. This dataset covers various complex road scenarios in Shanghai, China.
  • Toronto dataset: A publicly available dataset used to further validate the method's performance and robustness.

Key Insights and Ideas

  • Unordered Point Clouds are Challenging but Crucial: The paper highlights the practical importance of handling unordered point clouds, which are more representative of real-world sensor data than highly structured, ordered point clouds.
  • Multi-Stage Filtering is Key: No single technique is sufficient. The sequential application of grid height, normal vectors, clustering, and shape-based filtering progressively refines the curb extraction, effectively removing noise and obstacles.
  • Multi-Frame Fitting is a Game-Changer for Robustness: The core contribution of fitting the curb contour over multiple frames (specifically five) significantly improves accuracy and reduces the impact of transient noise or partial occlusions that plague single-frame methods. This is crucial for maintaining a continuous and accurate curb representation.
  • Sensitivity Analysis Validates Parameter Robustness: The authors performed thorough sensitivity analyses on their key parameters, demonstrating that the algorithm's performance is relatively stable within reasonable ranges, indicating good robustness across different conditions.

Key Results

  • The proposed method achieved an average F1 score of 0.8523 across various complex road scenarios (intersections, straight roads, curved roads, and scenarios with "ghosting" interference).
  • In complex scenarios like intersections and curved roads with ghosting, the proposed method outperformed a state-of-the-art method (Mi's method [31]) in terms of F1 score.
  • For the Toronto dataset, the proposed method achieved a precision of 0.9285, recall of 0.8521, and an F1 score of 0.8889, significantly outperforming Mi's method.
  • Qualitative results show that the multi-frame fitting approach effectively eliminates interference from road obstacles and vehicles, leading to a cleaner and more complete curb extraction compared to single-frame fitting.

Limitations and Future Work

  • Current Curb Matching Limitation: The current method is designed for matching up to two road curbs. Future work will focus on addressing challenges related to segmenting and matching more than two road curbs simultaneously.
  • Parameter Tuning: While sensitivity analysis shows robustness, optimal parameter selection is still necessary for peak performance. The paper provides recommended ranges and midpoints.
  • Computational Cost: While not explicitly detailed, multi-frame processing and multiple filtering stages can imply higher computational demands, which might be a consideration for real-time applications on resource-constrained platforms.

Summary updated

Abstract

Road curb extraction is a critical component of road environment perception, being essential for calculating road geometry parameters and ensuring the safe navigation of autonomous vehicles. The existing research primarily focuses on extracting curbs from ordered point clouds, which are constrained by their structure of point cloud organization, making it difficult to apply them to unordered point cloud data and making them susceptible to interference from obstacles. To overcome these limitations, a multi-feature-filtering-based method for curb extraction from unordered point clouds is proposed. This method integrates several techniques, including the grid height difference, normal vectors, clustering, an alpha-shape algorithm based on point cloud density, and the MSAC (M-Estimate Sample Consensus) algorithm for multi-frame fitting. The multi-frame fitting approach addresses the limitations of traditional single-frame methods by fitting the curb contour every five frames, ensuring more accurate contour extraction while preserving local curb features. Based on our self-developed dataset and the Toronto dataset, these methods are integrated to create a robust filter capable of accurately identifying curbs in various complex scenarios. Optimal threshold values were determined through sensitivity analysis and applied to enhance curb extraction performance under diverse conditions. Experimental results demonstrate that the proposed method accurately and comprehensively extracts curb points in different road environments, proving its effectiveness and robustness. Specifically, the average curb segmentation precision, recall, and F1 score values across scenarios A, B (intersections), C (straight road), and scenarios D and E (curved roads and ghosting) are 0.9365, 0.782, and 0.8523, respectively.
BibTeX
@inproceedings{hong2024multi,
  author = {Lang Hong and Peng Yuan and Zheng Zou and Shengxue Zhu and Yichuan Peng and Hao Du},
  title = {{Multi-Feature-Filtering-Based Road Curb Extraction from Unordered Point Clouds}},
  booktitle = {Sensors},
  year = {2024},
  doi = {10.3390/s24206544},
}
Figure