SVC: Sight view constraint for robust point cloud registration

Yaojie Zhang, Weijun Wang, Tianlun Huang, Zhiyong Wang, Wei FengImage 2024 · DOI

TL;DR

This paper introduces the Sight View Constraint (SVC), a novel method to identify incorrect point cloud registrations, especially in challenging low-overlap scenarios. By ensuring that transformed points don't block the sensor's view of the target cloud, SVC significantly boosts the robustness and recall of existing registration algorithms, achieving state-of-the-art results on datasets like 3DLoMatch.

What Problem Does This Paper Address?

Point cloud registration (PCR) is the process of aligning two 3D point clouds. A particularly difficult sub-problem is "partial-to-partial" registration, where the two clouds only overlap partially. This is exacerbated when the overlap is very low. The core challenge, as identified by the authors, is that the very definition of an "optimal" transformation in low-overlap partial registration is ill-defined. Existing metrics struggle to reliably distinguish the correct transformation from many plausible but incorrect ones, leading to poor robustness. This paper tackles this fundamental ambiguity by proposing a constraint that can definitively rule out incorrect transformations.

Methods

The authors propose a "Sight View Constraint" (SVC). The core idea is that in a static environment, a correctly registered source point cloud should not obstruct the line of sight from the sensor to the target point cloud. If a transformed source point lies directly between the sensor and a target point, it implies an incorrect transformation.

The SVC is implemented in several steps:

  1. Identify Non-Overlap: First, the non-overlapping points in the transformed source cloud are identified.
  2. Project to Sphere: Both the target cloud and the non-overlapping source points are projected onto a unit sphere centered at the sensor's assumed position.
  3. Calculate Blocked Points Count (BC): The algorithm checks for "blocked" sight lines. A sight line from the sensor to a target point is considered blocked if a transformed source point lies on that line and is closer to the sensor. The number of such blocked sight lines is quantified.
  4. Filter Hypotheses: If the BC metric exceeds a certain threshold (indicating too many blocked sight lines), the transformation hypothesis is deemed incorrect and rejected.

Crucially, SVC is not a standalone registration method but a general constraint that can be plugged into existing correspondence-based PCR pipelines. It's used to filter hypotheses generated by other methods, narrowing down the search space for the final optimal transformation. The authors also highlight the importance of the "decision version" of the PCR problem: determining if a given transformation is correct, which SVC directly addresses.

Datasets

The paper evaluates its method on several standard benchmarks:

  • Indoor: 3DMatch and 3DLoMatch. 3DLoMatch is specifically noted for its challenging low-overlap scenarios.
  • Outdoor: KITTI dataset.

The authors use existing feature descriptors like FPFH and FCGF for generating initial correspondences, as is common in the field.

Key Insights and Ideas

  • The "Ill-Defined" Nature of Partial PCR: The paper's central argument is that the lack of a clear objective function for low-overlap partial PCR is the root cause of its difficulty, not just the presence of outliers.
  • Sight as a Fundamental Constraint: The intuition that a correct registration shouldn't create self-occlusions from the sensor's perspective is a simple yet powerful idea.
  • SVC as a General Filter: SVC's strength lies in its generality; it can be applied to any correspondence-based PCR method that generates transformation hypotheses.
  • Decision Version is Key: The paper emphasizes that solving the "decision version" (is this transformation correct?) is a critical step towards solving the full PCR problem, especially in ambiguous low-overlap cases.

Key Results

  • Improved Recall: On the challenging 3DLoMatch dataset, SVC combined with SC2 boosted registration recall from 38.46% to 45.76% (using FPFH) and from 58.62% to 67.77% (using FCGF), outperforming other methods by a significant margin.
  • State-of-the-Art Performance: SVC achieved state-of-the-art results on 3DLoMatch, increasing recall from 78% to 82% (as stated in the abstract).
  • Robustness: SVC significantly improves the robustness of existing methods, particularly in low-overlap scenarios.
  • Generalization: The method shows effectiveness on both indoor and outdoor datasets (KITTI).
  • Time Efficiency: SVC adds minimal overhead, with execution times typically in the milliseconds range, even with a large number of points.

Limitations and Future Work

  • Time Complexity Bottleneck: The primary computational bottleneck identified is the matrix multiplication involved in finding nearest neighbors for projection and distance calculations, leading to O(N²) complexity in its current form. While optimized versions exist, this remains an area for improvement.
  • Hypothesis Generation: SVC relies on existing methods to generate hypotheses. Its performance is thus indirectly dependent on the quality of these initial hypotheses.
  • Sensor Position Assumption: The method assumes the sensor position is known (or can be translated to (0,0,0)).
  • Future Work: The authors suggest that further research into efficiently generating hypotheses that are more likely to contain the correct transformation, building upon the insights from the decision version problem, is a promising direction. They also highlight that SVC can be integrated with various metrics and methods, suggesting potential for further exploration.

Summary updated

Abstract

Partial to Partial Point Cloud Registration (partial PCR) remains a challenging task, particularly when dealing with a low overlap rate. In comparison to the full-to-full registration task, we find that the objective of partial PCR is still not well-defined, indicating no metric can reliably identify the true transformation. We identify this as the most fundamental challenge in partial PCR tasks. In this paper, instead of directly seeking the optimal transformation, we propose a novel and general Sight View Constraint (SVC) to conclusively identify incorrect transformations, thereby enhancing the robustness of existing PCR methods. Extensive experiments validate the effectiveness of SVC on both indoor and outdoor scenes. On the challenging 3DLoMatch dataset, our approach increases the registration recall from 78% to 82%, achieving the state-of-the-art result. This research also highlights the significance of the decision version problem of partial PCR, which has the potential to provide novel insights into the partial PCR problem. Code will be available at: https://github.com/pppyj-m/SVC . • We propose a method (SVC) that could identify incorrect transformations. • Experiments demonstrate that the SVC applies to both indoor and outdoor scenes. • We underscore the decision version of the PCR problem as the fundamental challenge.
BibTeX
@inproceedings{zhang2024svc,
  author = {Yaojie Zhang and Weijun Wang and Tianlun Huang and Zhiyong Wang and Wei Feng},
  title = {{SVC: Sight view constraint for robust point cloud registration}},
  booktitle = {Image},
  year = {2024},
  doi = {10.1016/j.imavis.2024.105315},
}
Figure