Online Range Image-based Pole Extractor for Long-term LiDAR Localization in Urban Environments

Hao Dong, Xieyuanli Chen, Cyrill Stachniss

TL;DR

This paper introduces a novel and efficient method for extracting poles from LiDAR scans using range images, which significantly speeds up processing compared to traditional point cloud methods. This allows for robust, long-term localization of autonomous vehicles in urban environments, even without the need for a GPU.

What Problem Does This Paper Address?

Accurate and reliable localization is fundamental for autonomous systems, enabling them to navigate safely and perform tasks. While GPS is useful, it's often unreliable in urban canyons due to signal blockage. LiDAR-based localization offers a more robust alternative, but creating and maintaining large-scale maps can be memory-intensive. A promising approach is to use distinctive, long-term stable landmarks like poles. However, existing pole extraction methods can be computationally expensive, hindering their use in real-time, online localization systems. This paper aims to bridge this gap by developing a fast and accurate pole extraction method that can operate online and contribute to robust long-term localization.

Methods

The core innovation lies in processing LiDAR data using range images instead of raw 3D point clouds.

  • Range Image Generation: LiDAR points are projected into spherical coordinates and then mapped to a 2D range image. This representation preserves spatial neighborhood information in a more compact and computationally friendly format.
  • Pole Extraction: The algorithm operates directly on these range images. It first clusters pixels based on range values to identify potential objects. Then, it applies geometric constraints, such as aspect ratio, range differences with neighbors, and height variations, to filter out non-pole objects. Finally, it fits circles to the 3D coordinates of the remaining candidates to determine pole positions and radii. This projection-based approach avoids costly 3D point cloud processing.
  • Mapping: Extracted poles from ground-truth trajectories are used to build a 2D global pole map.
  • Localization: Monte Carlo Localization (MCL) is employed. The observation model uses the detected poles from the current scan to update particle weights by matching them against the global pole map.

Datasets

  • NCLT Dataset: Used for evaluating pole extraction performance and localization. The authors manually labeled poles and released this dataset for public research.
  • SemanticKITTI Dataset: Used for evaluating pole extraction performance. The authors extracted pole-like objects from sequences 00-10.
  • MulRan Dataset: Used for localization evaluation, collected in Korea with a different LiDAR sensor.
  • KITTI Odometry Dataset: Used for localization evaluation, a standard benchmark for autonomous driving.

Key Insights and Ideas

  • Range Images as a Game Changer: The paper demonstrates that processing LiDAR data via range images, rather than raw point clouds, offers a significant speedup without sacrificing crucial spatial information for pole extraction. This is key to achieving online performance.
  • Geometric Constraints for Robustness: The method relies on a series of carefully chosen geometric constraints (aspect ratio, range differences, height variations) to reliably identify pole-like structures, making it robust to varying environments and sensor types.
  • Long-Term Localization Potential: By focusing on stable, long-term landmarks like poles, the approach is well-suited for applications requiring consistent localization over extended periods and across different environmental conditions.
  • GPU-Free Operation: The ability to run the entire system online without a GPU is a significant practical advantage, reducing hardware requirements and enabling deployment on less powerful platforms.

Key Results

  • Pole Extraction Performance: The proposed method outperforms the baseline method (Schaefer et al. [19]) in both precision and recall on the NCLT and SemanticKITTI datasets, extracting more poles accurately.
  • Localization Accuracy: The approach achieves superior localization accuracy across multiple datasets (NCLT, MulRan, KITTI) compared to state-of-the-art methods, with significantly lower position and orientation errors. Notably, it avoids losing track of the robot's pose in challenging scenarios where baselines fail.
  • Runtime Efficiency: The pole extraction and MCL steps are fast enough to run online at the sensor frame rate (10 Hz) without requiring a GPU. The pole extraction takes less than 0.09 seconds, and MCL steps take less than 0.1 seconds.

Limitations and Future Work

  • Limitations: The paper acknowledges that the NCLT ground-truth poses used for mapping were not perfectly accurate, leading to slightly blurry point clouds. The pole extraction method might struggle in environments with very few poles or where poles are heavily occluded.
  • Future Work: The authors plan to explore the integration of other features, such as road markings, curbs, and intersection features, to further enhance the robustness of their localization method.

Summary updated

Abstract

Reliable and accurate localization is crucial for mobile autonomous systems. Pole-like objects, such as traffic signs, poles, lamps, etc., are ideal landmarks for localization in urban environments due to their local distinctiveness and long-term stability. In this paper, we present a novel, accurate, and fast pole extraction approach that runs online and has little computational demands such that this information can be used for a localization system. Our method performs all computations directly on range images generated from 3D LiDAR scans, which avoids processing 3D point cloud explicitly and enables fast pole extraction for each scan. We test the proposed pole extraction and localization approach on different datasets with different LiDAR scanners, weather conditions, routes, and seasonal changes. The experimental results show that our approach outperforms other state-of-the-art approaches, while running online without a GPU. Besides, we release our pole dataset to the public for evaluating the performance of pole extractor, as well as the implementation of our approach.
BibTeX
@inproceedings{dong2021online,
  author = {Hao Dong and Xieyuanli Chen and Cyrill Stachniss},
  title = {{Online Range Image-based Pole Extractor for Long-term LiDAR Localization in Urban Environments}},
  booktitle = {ECMR},
  year = {2021},
  url = {https://openreview.net/forum?id=2v-xOG3pHj},
}
Figure