LUOJIA Explorer PMS: Panoramic Odometry and Mapping with Structural Information

Yuhang Xu, Chi Chen, Bisheng Yang, Liuchun Li, Zhiye Wang, Shangzhe Sun, Zhengfei Yan, Shaolong Wu2025 · DOI

TL;DR

The LUOJIA Explorer PMS is a new multi-sensor mapping system that overcomes the "blind spots" and data sparsity of traditional mobile mapping. By fusing data from two different solid-state LiDARs, an IMU, and a panoramic camera, the researchers developed a submap-based method to reliably extract structural edge features from sparse point clouds—paving the way for more accurate, "texture-aware" 3D reconstructions.

What Problem Does This Paper Address?

Creating dense, accurate 3D maps of unknown environments (like underground tunnels or planetary surfaces) is difficult for two main reasons:

  1. Blind Spots: Most systems use a single LiDAR or cameras with a limited Field of View (FOV), leaving the robot "blind" to its sides or rear.
  2. Sparsity in Solid-State LiDARs: Modern solid-state LiDARs often use "non-repetitive" scanning patterns. While great for coverage over time, a single frame is extremely sparse, making it nearly impossible to extract sharp structural features like the edges of walls or pillars using traditional methods (like LOAM).

The authors aim to bridge this gap by creating a system that sees in 360 degrees and "thickens" sparse data into usable structural information.

Methods

The researchers introduced a hardware-software co-design called the LuoJia Explorer PMS:

  • Hardware Fusion: The system combines a Livox Mid360 (360° horizontal FOV) for wide coverage and a Livox Avia for long-range forward sensing. It also includes a THETA Z1 360° camera and a high-frequency IMU.
  • Multi-LiDAR-Inertial Odometry: They utilize an Iterated Extended Kalman Filter (iEKF) to fuse LiDAR and IMU data. This compensates for motion distortion and provides a precise real-time pose for the robot.
  • Submap-based Edge Extraction: This is the core innovation. Instead of trying to find edges in a single, sparse LiDAR frame, they accumulate frames into a submap. They then process this submap through a four-step pipeline:
  • Voxelization: Segmenting the submap into small cubes.
  • Plane Fitting: Using RANSAC to find flat surfaces within each cube.
  • Plane Selection: Identifying where these planes intersect at significant angles.
  • Line Computation: Calculating the exact intersection line to define a "depth-continuous" edge.
  • Panorama Processing: They also extract line features from the 360° images using a Line Segment Detector (LSD) adapted for spherical distortions.

Datasets

The researchers evaluated their system using a custom dataset collected at an underground parking garage at Wuhan University.

  • Environment: A structured, GNSS-denied environment with plenty of pillars, walls, and sharp geometric features.
  • Comparison: While they don't benchmark against public datasets like KITTI in this specific paper, they use the site to qualitatively validate that their submap method finds edges that single-frame methods would miss.

Key Insights and Ideas

  • Accumulation is Key: The "aha moment" is that the non-repetitive nature of solid-state LiDARs is a feature, not a bug. By waiting a few frames and accumulating a submap, the "sparse" scan becomes a dense "paint" of the environment, allowing for much more robust geometric analysis.
  • Complementary LiDARs: By placing the Mid360 on top for FOV and the Avia facing forward for range, the system achieves a "best of both worlds" perception field that minimizes blind spots while maintaining long-distance look-ahead.
  • Structural Bridges: Extracting edges from both the point cloud and the panoramic images creates a common "language" (lines/edges) that can be used to perfectly align 2D textures with 3D geometry in future work.

Key Results

  • Mapping Quality: The system produced a point cloud map of the parking garage that was "stratification-free," meaning the odometry was precise enough that multiple passes over the same area didn't create ghosting or misaligned layers.
  • Edge Accuracy: Qualitative results (Figure 4) show that the submap method successfully identified the structural "skeleton" of the parking garage, even in areas where the raw LiDAR data appeared sparse.
  • Visual Integration: The system successfully extracted line features from distorted panoramic images, demonstrating that these visual edges align well with the geometric edges found in the LiDAR submaps.

Limitations and Future Work

  • Sparse Area Failure: The authors admit that in very sparse areas of the point cloud (e.g., far-off objects), edge extraction still struggles.
  • Fixed Voxel Size: The current method uses a fixed-size voxel for plane fitting. They suggest that adaptive voxel sizes (changing size based on point density) could significantly improve results.
  • Joint Optimization: This paper focuses on extracting the features. The next step is to use these shared edge features to perform "joint optimization"—mathematically locking the panoramic images to the point cloud to create a perfectly textured, photorealistic 3D model.

Summary updated

Abstract

Accurate dense reconstruction of unknown spatial environments is crucial for applications such as underground exploration and planetary missions. Existing methods face challenges like observing blind spots and the difficulty of edge feature extraction in point clouds with non-repetitive scanning LiDARs. This paper first uses a novel odometry and mapping system integrating two solid-state LiDARs and an IMU to obtain distortion-compensated point clouds and corresponding poses, which are utilized to generate submaps. Our approach then leverages these accumulated submaps to efficiently extract edge features. Experimental results demonstrate that our submap-based method effectively identifies edge features within point clouds, which can be used for association with panoramas for joint optimization in the future.
BibTeX
@inproceedings{xu2025luojia,
  author = {Yuhang Xu and Chi Chen and Bisheng Yang and Liuchun Li and Zhiye Wang and Shangzhe Sun and Zhengfei Yan and Shaolong Wu},
  title = {{LUOJIA Explorer PMS: Panoramic Odometry and Mapping with Structural Information}},
  booktitle = {˜The},
  year = {2025},
  doi = {10.5194/isprs-archives-xlviii-2-2024-485-2025},
}
Figure