DLBAcalib: Robust Extrinsic Calibration for Non-Overlapping LiDARs Based on Dual LBA

Ye Han, Yuqiang Jin, Jinyuan Liu, Tao Li, Wen-An Zhang, Minglei Fu

TL;DR

DLBAcalib is a novel, targetless framework for calibrating multiple LiDARs that have zero overlapping fields of view. By combining sliding-window LiDAR Bundle Adjustment (LBA) with an adaptive weighting mechanism, it achieves millimeter-level accuracy (5 mm translation, 0.2° rotation) even with highly imprecise initial guesses.

What Problem Does This Paper Address?

In the world of autonomous driving and 3D mapping, more LiDARs are usually better. However, getting these sensors to "talk" to each other in the same coordinate system—a process called extrinsic calibration—is notoriously difficult.

Most existing methods rely on two things:

  1. Overlapping Fields of View (FoV): The sensors must see the same objects simultaneously to find correspondences.
  2. Artificial Targets: You often need to set up checkerboards or reflective poles in a controlled environment.

But what if your LiDARs are facing opposite directions (e.g., one forward, one backward)? Or what if you're in a "wild" environment without calibration boards? Conventional methods break down here. Furthermore, many algorithms require a very accurate "initial guess" to converge; if your starting estimate is off by more than a few centimeters, the calibration fails. DLBAcalib tackles these challenges head-on, offering a targetless solution for non-overlapping sensors that is robust to poor initial parameters.

Methods

The core innovation of the paper is the Dual LBA (LiDAR Bundle Adjustment) approach. The process unfolds in three main stages:

  1. Building the Reference Map (LiDAR A): The system uses one LiDAR as a "target." It employs a sliding-window LBA to refine the sensor's trajectory and build a high-fidelity global point cloud map. Unlike standard odometry, LBA optimizes the poses across multiple frames simultaneously to minimize registration errors and drift.
  2. Adaptive Feature Extraction: To make the data manageable and robust, the global map is divided into voxels. The authors use an adaptive voxelization strategy—subdividing complex areas into smaller cubes—to extract high-quality planar features. They also introduce a confidence weighting mechanism that prioritizes stable, clear surfaces over noisy ones.
  3. Joint Optimization (The "Dual" part): The second LiDAR (LiDAR B) is then aligned to the global map built by LiDAR A. Because the vehicle has moved, LiDAR B eventually "sees" the same environment LiDAR A saw moments ago. The framework formulates this as a joint optimization problem, iteratively refining the extrinsic transformation ($T_B^A$) between the two sensors.

The authors use the Levenberg-Marquardt (LM) algorithm for the optimization and Lie algebra ($se(3)$) to represent the transformations, ensuring mathematical consistency.

Datasets

The researchers validated DLBAcalib using two primary sources:

  • CARLA Simulator: They tested five different dual-LiDAR configurations with varying mounting angles and positions to simulate diverse real-world setups.
  • Real-World Backpack Platform: A custom-built rig featuring two PandarXT16 LiDARs and an Xsens Mti-630 IMU. This setup specifically featured minimal FoV overlap to test the limits of the algorithm.

Key Insights and Ideas

  • The Map is the Bridge: The most important "aha" moment is that temporal overlap can replace spatial overlap. Even if two sensors never see the same thing at the same time, they can be calibrated if they both contribute to a consistent global map over time.
  • Robustness to "Bad" Starts: Most calibration tools require an initial guess within a few centimeters. DLBAcalib is remarkably "forgiving," tolerating initial errors of up to 0.4 meters and 30 degrees. This significantly reduces the need for precise manual measurements during sensor mounting.
  • Adaptive Weighting: By calculating a "planarity index" and confidence weights for voxels, the system naturally ignores outliers (like moving objects or foliage) that would otherwise skew the calibration results.

Key Results

DLBAcalib was compared against state-of-the-art methods like MLCC and PCDcalib. The results were impressive:

  • Accuracy: In non-overlapping configurations, it achieved an average translational error of 5 mm and a rotational error of 0.2°.
  • Consistency: As shown in the paper's iteration plots, the algorithm consistently converges to the ground truth across multiple trials with randomized initial perturbations.
  • Efficiency: The sliding-window approach and multi-threaded parallel computation allow the system to handle large-scale point clouds without a massive computational bottleneck.

Limitations and Future Work

While DLBAcalib is a significant step forward, the authors note a few areas for growth:

  • Dynamic Environments: While the weighting mechanism helps, extremely crowded or fast-changing environments could still pose challenges for building the initial reference map.
  • Sensor Diversity: The current study focuses on dual-LiDAR setups. Future work aims to extend the framework to handle more sensors (LiDAR-camera-radar) and further improve computational efficiency for real-time applications.

Check out the code: The authors have open-sourced their ROS-based implementation on GitHub: https://github.com/Silentbarber/DLBAcalib

Summary updated

Abstract

Accurate extrinsic calibration of multiple LiDARs is crucial for improving the foundational performance of three-dimensional (3D) map reconstruction systems. This paper presents a novel targetless extrinsic calibration framework for multi-LiDAR systems that does not rely on overlapping fields of view or precise initial parameter estimates. Unlike conventional calibration methods that require manual annotations or specific reference patterns, our approach introduces a unified optimization framework by integrating LiDAR bundle adjustment (LBA) optimization with robust iterative refinement. The proposed method constructs an accurate reference point cloud map via continuous scanning from the target LiDAR and sliding-window LiDAR bundle adjustment, while formulating extrinsic calibration as a joint LBA optimization problem. This method effectively mitigates cumulative mapping errors and achieves outlier-resistant parameter estimation through an adaptive weighting mechanism. Extensive evaluations in both the CARLA simulation environment and real-world scenarios demonstrate that our method outperforms state-of-the-art calibration techniques in both accuracy and robustness. Experimental results show that for non-overlapping sensor configurations, our framework achieves an average translational error of 5 mm and a rotational error of 0.2°, with an initial error tolerance of up to 0.4 m/30°. Moreover, the calibration process operates without specialized infrastructure or manual parameter tuning. The code is open source and available on GitHub (\underline{https://github.com/Silentbarber/DLBAcalib})
BibTeX
@misc{han2025dlbacalib,
  author = {Ye Han and Yuqiang Jin and Jinyuan Liu and Tao Li and Wen-An Zhang and Minglei Fu},
  title = {{DLBAcalib: Robust Extrinsic Calibration for Non-Overlapping LiDARs Based on Dual LBA}},
  year = {2025},
  eprint = {2507.09176},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2507.09176},
}
Figure