Bridge Geometric Shape Measurement Using LiDAR–Camera Fusion Mapping and Learning-Based Segmentation Method

Shang Jiang, Yifan Yang, Siyang Gu, Jiahui Li, Yingyan HouBuildings 2025 · DOI

TL;DR

This paper introduces a novel LiDAR-camera fusion system for rapid and accurate 3D geometric shape measurement of bridges. By combining real-time 3D reconstruction with a deep learning-based segmentation approach, the method efficiently extracts key structural components, significantly improving accuracy and reducing processing time compared to traditional methods.

What Problem Does This Paper Address?

Accurate and efficient measurement of bridge geometric shapes is vital for construction quality assessment and monitoring structural integrity throughout a bridge's lifespan. Traditional methods, like manual total station measurements, are time-consuming, dangerous, and provide sparse data. While advancements in vision-based and laser scanning technologies have improved efficiency, challenges remain in achieving high-precision, large-scale 3D reconstruction and automated component extraction, especially in complex bridge environments with sparse features and varying lighting. Existing methods often struggle with computational demands for processing massive point clouds and require significant post-processing for alignment.

Methods

The proposed framework integrates three key components:

  1. Synchronized LiDAR-Camera Fusion System: An unmanned aerial vehicle (UAV) equipped with a LiDAR sensor, an industrial camera, and an Inertial Measurement Unit (IMU) forms the data acquisition platform. Temporal synchronization is achieved using GPS and a microcontroller, while intrinsic and extrinsic calibration (LiDAR-IMU and LiDAR-camera) are performed to ensure accurate data fusion.
  2. Multi-Sensor Fusion Mapping: A tightly coupled Visual-Inertial Odometry (VIO) and LiDAR-Inertial Odometry (LIO) system (based on FAST-LIVO2) is employed for robust, real-time 3D point cloud reconstruction. This hybrid approach leverages the strengths of both visual data (dense features at close range) and LiDAR (superior spatial constraints at longer distances) to create globally consistent 3D models, even in challenging environments.
  3. Learning-Based Segmentation: A novel instance segmentation network is proposed for automated detection and segmentation of bridge components directly from images. This approach focuses on fine-grained edge segmentation. The 2D segmentation masks are then projected into the 3D point cloud using calibrated parameters to extract the 3D coordinates of the components. This method avoids direct processing of massive point clouds, reducing computational requirements.

Datasets

The paper mentions the creation of a dataset comprising 300 UAV-captured images of bridge arches. These images were manually annotated to create training and evaluation data for the segmentation network.

Key Insights and Ideas

  • Bridging the Gap with Fusion: The core insight is that combining LiDAR's geometric precision with camera's rich visual information, especially through a well-calibrated and synchronized system, is key to overcoming the limitations of individual sensors for complex bridge structures.
  • Image-First Segmentation for Efficiency: Instead of processing massive 3D point clouds directly for segmentation, the approach prioritizes 2D image segmentation. This significantly reduces computational load and makes the process more efficient, especially for large-scale structures.
  • Robustness in Challenging Environments: The VIO-LIO fusion mapping strategy is designed to be robust even in "textureless or feature-scarce environments," which are common for bridge structures, ensuring stable reconstruction.
  • Deep Learning for Precision Edges: The development of a specialized instance segmentation network that focuses on refining edge detection is crucial. This is because the accuracy of component segmentation directly impacts the precision of the final 3D geometric measurements.

Key Results

  • Accuracy Improvement: The proposed method reduced the average error by 77.13% compared to oblique photogrammetry. Specifically, mean errors were reported as 0.083m (X-axis), 0.103m (Y-axis), and 0.061m (Z-axis) for the proposed method, compared to significantly larger errors for oblique photogrammetry.
  • Time Efficiency: The total processing time for the proposed method was 4.18% of that required by stationary laser scanning and 0.29% of that needed for oblique photogrammetry.
  • Segmentation Accuracy: The hierarchical bridge component segmentation network achieved 94.23% accuracy in bridge component identification.
  • Real-time Performance: The system demonstrated real-time point cloud updates during flight and an average processing time of 2 seconds from image segmentation to point cloud segmentation for a single frame.

Limitations and Future Work

  • LiDAR Accuracy: The current system uses a low-cost, non-repetitive scanning LiDAR, which has inherent accuracy limitations compared to expensive, high-precision scanners. This contributed to the observed 8.3 cm error compared to static TLS. Future work suggests using higher accuracy LiDAR to improve this.
  • Segmentation Specificity: The current segmentation network is trained specifically for arch segmentation in concrete arch bridges. It cannot yet segment other components like cables or girders. Future research aims to expand the dataset to include these components and bridge types.
  • Data Dependency: The image-based segmentation approach means the method is currently tied to data collected by the proposed LiDAR-camera fusion system. Future work aims to generalize this to data from other devices.

Summary updated

Abstract

The rapid measurement of three-dimensional bridge geometric shapes is crucial for assessing construction quality and in-service structural conditions. Existing geometric shape measurement methods predominantly rely on traditional surveying instruments, which suffer from low efficiency and are limited to sparse point sampling. This study proposes a novel framework that utilizes an airborne LiDAR–camera fusion system for data acquisition, reconstructs high-precision 3D bridge models through real-time mapping, and automatically extracts structural geometric shapes using deep learning. The main contributions include the following: (1) A synchronized LiDAR–camera fusion system integrated with an unmanned aerial vehicle (UAV) and a microprocessor was developed, enabling the flexible and large-scale acquisition of bridge images and point clouds; (2) A multi-sensor fusion mapping method coupling visual-inertial odometry (VIO) and Li-DAR-inertial odometry (LIO) was implemented to construct 3D bridge point clouds in real time robustly; and (3) An instance segmentation network-based approach was proposed to detect key structural components in images, with detected geometric shapes projected from image coordinates to 3D space using LiDAR–camera calibration parameters, addressing challenges in automated large-scale point cloud analysis. The proposed method was validated through geometric shape measurements on a concrete arch bridge. The results demonstrate that compared to the oblique photogrammetry method, the proposed approach reduces errors by 77.13%, while its detection time accounts for 4.18% of that required by a stationary laser scanner and 0.29% of that needed for oblique photogrammetry.
BibTeX
@inproceedings{jiang2025bridge,
  author = {Shang Jiang and Yifan Yang and Siyang Gu and Jiahui Li and Yingyan Hou},
  title = {{Bridge Geometric Shape Measurement Using LiDAR–Camera Fusion Mapping and Learning-Based Segmentation Method}},
  booktitle = {Buildings},
  year = {2025},
  doi = {10.3390/buildings15091458},
}
Figure