Multi-View Point Cloud Registration Based on Evolutionary Multitasking With Bi-Channel Knowledge Sharing Mechanism

Yue Wu, Yibo Liu, Maoguo Gong, Peiran Gong, Hao Li, Zedong Tang, Qiguang Miao, Wenping Ma

TL;DR

This paper tackles the challenging problem of multi-view 3D point cloud registration by framing it as an evolutionary multi-task optimization problem. They introduce a novel "bi-channel" knowledge sharing mechanism that leverages simpler "aiding" tasks to accelerate learning and explores inter-task commonalities to prevent getting stuck in local optima, leading to more accurate and robust registration.

What Problem Does This Paper Address?

Reconstructing 3D objects or scenes from multiple scans often involves point cloud registration, which is the process of aligning different point clouds into a common coordinate system. A key challenge in multi-view point cloud registration is ensuring global consistency across all scans. Simply registering pairs of point clouds sequentially can lead to accumulated errors, creating gaps and distortions in the final reconstruction. Existing methods often struggle to balance the need for accurate pairwise alignment (local accuracy) with the requirement that all point clouds fit together seamlessly (global consistency). This paper aims to address this by developing a method that optimizes both aspects simultaneously.

Methods

The core of the proposed method, MTPCR (MultiTasking Point Cloud Registration), lies in its formulation as an evolutionary multi-task optimization (EMTO) problem. Instead of solving each pairwise registration independently, MTPCR treats the registration of multiple point clouds (specifically, those forming a loop, like P1, P2, P3) as interconnected tasks.

The key innovations are:

  • Multi-Task Optimization Framework: The problem is broken down into multiple related tasks, allowing for concurrent optimization. This includes "original tasks" that aim to optimize both local accuracy and global consistency, and simpler "aiding tasks" designed to facilitate learning.
  • Bi-Channel Knowledge Sharing Mechanism: This is the heart of MTPCR and consists of two parts:
  • Intra-task Knowledge Sharing: Aiding tasks, which are simpler versions of the original registration tasks (e.g., optimizing only for local accuracy), are introduced. Knowledge (genetic material) is shared between these aiding tasks and their corresponding original tasks. This helps accelerate the convergence of the original tasks.
  • Inter-task Knowledge Sharing: This mechanism leverages the inherent relationships between the registration tasks (enforced by the global consistency constraint). It allows for sharing of knowledge between different original tasks, helping to prevent them from getting stuck in local optima.
  • Fitness Function: A robust fitness function is designed that incorporates both local accuracy (using an adaptive threshold to handle noise and outliers) and global consistency (via a loop closure constraint).

Datasets

The authors evaluated their method on several standard datasets:

  • Stanford 3D Scanning Repository: Contains model objects like Bunny, Dragon, Armadillo, and Buddha.
  • Aim@Shape project: Used for model objects like Buste.
  • Augmented ICL-NUIM Dataset: Used for indoor scene point clouds like Room and Office.

These datasets provide point clouds captured from various viewpoints, with known ground truth transformations, allowing for quantitative evaluation of registration accuracy.

Key Insights and Ideas

  • Multi-task optimization is a natural fit for multi-view registration: The interconnectedness of pairwise registrations in a multi-view scenario makes it amenable to EMTO, allowing for simultaneous optimization of local and global properties.
  • Aiding tasks are crucial for accelerating learning: Introducing simpler, related tasks significantly boosts the convergence speed of the more complex original tasks, which would otherwise struggle.
  • Inter-task sharing prevents local optima: By exploiting the global consistency constraints, knowledge can be shared across different registration pairs, guiding the search away from suboptimal solutions.
  • A balance between local and global is key: The proposed fitness function effectively balances the need for precise pairwise alignment with the requirement for overall scene consistency.
  • Explicit EMTO is beneficial for this problem: Unlike implicit EMTO methods that rely on random crossovers, MTPCR's explicit, controlled knowledge sharing leads to better performance.

Key Results

  • Superior Registration Accuracy: MTPCR consistently achieved superior or competitive registration accuracy compared to state-of-the-art methods like TrICP, KMEANS, EMPMR, and LSG-CPD, especially on challenging datasets with low overlap ratios.
  • Robustness to Noise: The method demonstrated good performance even when subjected to varying levels of Gaussian noise, outperforming many other methods.
  • Improved Solution Quality: In terms of solution quality (fitness values), MTPCR significantly outperformed MFEA, GMFEA, and MTPCR variants with only one type of knowledge sharing.
  • Faster Convergence: MTPCR showed faster convergence rates compared to other EMTO methods, particularly for the original, more complex tasks.

Limitations and Future Work

  • Parameter Sensitivity: The paper investigates the sensitivity of parameters like $\alpha$ (balancing local accuracy and global consistency) and knowledge sharing probabilities ($p_{intra}$, $p_{inter}$). While optimal ranges are identified, fine-tuning might still be necessary for specific datasets.
  • Computational Cost: While MTPCR is efficient, EMTO methods generally involve managing multiple populations, which can increase computational demands compared to single-task algorithms.
  • Future Work: The authors suggest further exploration of parameter sensitivity and the potential for applying this framework to other related problems. The effectiveness of the bi-channel mechanism suggests potential for broader applications in complex optimization scenarios.

Summary updated

Abstract

Multi-view point cloud registration is fundamental in 3D reconstruction. Since there are close connections between point clouds captured from different viewpoints, registration performance can be enhanced if these connections be harnessed properly. Therefore, this article models the registration problem as multi-task optimization, and proposes a novel bi-channel knowledge sharing mechanism for effective and efficient problem solving. The modeling of multi-view point cloud registration as multi-task optimization are twofold. By simultaneously considering the local accuracy of two point clouds as well as the global consistency posed by all the point clouds involved, a fitness function with an adaptive threshold is derived. Also a framework of the co-evolutionary search process is defined for the concurrent optimization of multiple fitness functions belonging to related tasks. To enhance solution quality and convergence speed, the proposed bi-channel knowledge sharing mechanism plays its role. The intra-task knowledge sharing introduces aiding tasks that are much simpler to solve, and useful information is shared across aiding tasks and the original tasks, accelerating the search process. The inter-task knowledge sharing explores commonalities buried among the original tasks, aiming to prevent tasks from getting stuck to local optima. Comprehensive experiments conducted on model object as well as scene point clouds show the efficacy of the proposed method.
BibTeX
@article{wu2022multi,
  author = {Yue Wu and Yibo Liu and Maoguo Gong and Peiran Gong and Hao Li and Zedong Tang and Qiguang Miao and Wenping Ma},
  title = {{Multi-View Point Cloud Registration Based on Evolutionary Multitasking With Bi-Channel Knowledge Sharing Mechanism}},
  journal = {IEEE Transactions on Emerging Topics in Computational Intelligence},
  year = {2022},
  doi = {10.1109/tetci.2022.3205384},
}
Figure