NAR-*ICP: Neural Execution of Classical ICP-based Pointcloud Registration Algorithms

Efimia Panagiotaki, Daniele De Martini, Lars Kunze, Petar Velickovic

Abstract

Classical robotics algorithms like Iterative Closest Point (ICP) are interpretable and modular but often struggle with noise and poor initialization. Deep learning approaches offer robustness but typically operate as "black boxes." This paper introduces NAR-*ICP, a framework that applies Neural Algorithmic Reasoning (NAR) to point cloud registration. By training Graph Neural Networks (GNNs) to execute the step-by-step logic of ICP algorithms using intermediate "hints," NAR-ICP achieves superior accuracy and robustness compared to traditional methods. The resulting models are lightweight, interpretable, and capable of surpassing the performance of the classical algorithms they were trained to mimic.

Introduction

In robotics, point cloud registration—the process of aligning two 3D datasets—is a fundamental task. The trade-off between classical algorithms and neural networks is well-documented: classical ICP is predictable but fragile, while neural networks are robust but opaque. NAR-ICP addresses this by creating a hybrid system where a neural network learns to "reason" through the intermediate computational steps of a proven robotics algorithm.

Methodology

The NAR-ICP framework extends the CLRS-30 benchmark into the robotics domain, representing point clouds as dynamic bipartite graphs where nodes are points and edges represent potential correspondences.

Architecture

The system follows an Encoder-Processor-Decoder structure:

  1. Encoders: Transform raw 3D coordinates and semantic labels into latent embeddings.
  2. Processor: A recurrent GNN (specifically a Triplet-MPNN) that performs iterative reasoning steps.
  3. Decoders: Translate latent states back into predicted point positions and correspondences.
Overview of the NAR-*ICP* iterative execution pipeline, showing the transition from input graphs through recurrent GNN steps to the final output.

Algorithmic Hints and Termination

A core component of the NAR approach is the use of algorithmic hints. During training, the network is supervised on the intermediate states of a classical ICP algorithm, such as current correspondences, distances, and error metrics. This guides the latent space to follow a logical trajectory.

Table of features and probes used as algorithmic hints during training, categorized by input, intermediate hints, and output.

Furthermore, the model includes a learned termination network. Unlike standard NAR models that run for a fixed number of iterations, this network learns to detect convergence, significantly improving inference speed by reducing the number of required steps by over 2x.

Experimental Evaluation

The framework was evaluated on both synthetic and real-world datasets (SemanticKITTI).

Key Results

  • Accuracy: NAR-ICP variants significantly outperformed classical baselines. On SemanticKITTI, the NAR-P2L+ model achieved a Relative Translation Error (RTE) of 0.135m, a massive improvement over the 1.032m error of classical P2L-ICP.
  • Efficiency: The model is highly optimized, featuring only 773k parameters—orders of magnitude smaller than many state-of-the-art deep learning registration models like DGR (235M parameters).
  • Robustness: By learning to infer an optimal initial alignment, NAR-ICP avoids the local minima that often plague classical ICP when starting from large offsets.

Discussion and Conclusion

NAR-ICP demonstrates that neural networks can "surpass their teacher." By training on both successful algorithmic steps and adversarial examples where classical ICP fails, the neural execution becomes more resilient. The use of hints makes the model's "trajectories" interpretable, allowing researchers to monitor convergence.

Future work will focus on scaling this approach to dense geometric features and integrating NAR-ICP into full-scale SLAM and path-planning systems for real-time robotics applications.

Summary updated

Abstract

This study explores the intersection of neural networks and classical robotics algorithms through the Neural Algorithmic Reasoning (NAR) framework, allowing to train neural networks to effectively reason like classical robotics algorithms by learning to execute them. Algorithms are integral to robotics and safety-critical applications due to their predictable and consistent performance through logical and mathematical principles. In contrast, while neural networks are highly adaptable, handling complex, high-dimensional data and generalising across tasks, they often lack interpretability and transparency in their internal computations. We propose a Graph Neural Network (GNN)-based learning framework, NAR-*ICP, which learns the intermediate algorithmic steps of classical ICP-based pointcloud registration algorithms, and extend the CLRS Algorithmic Reasoning Benchmark with classical robotics perception algorithms. We evaluate our approach across diverse datasets, from real-world to synthetic, demonstrating its flexibility in handling complex and noisy inputs, along with its potential to be used as part of a larger learning system. Our results indicate that our method achieves superior performance across all benchmarks and datasets, consistently surpassing even the algorithms it has been trained on, further demonstrating its ability to generalise beyond the capabilities of traditional algorithms.
BibTeX
@misc{panagiotaki2024nar,
  author = {Efimia Panagiotaki and Daniele De Martini and Lars Kunze and Petar Velickovic},
  title = {{NAR-*ICP: Neural Execution of Classical ICP-based Pointcloud Registration Algorithms}},
  year = {2024},
  eprint = {2410.11031},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2410.11031},
}
Figure