CorAl: Introspection for robust radar and lidar perception in diverse environments using differential entropy

Daniel Adolfsson, Manuel Castellano-Quero, Martin Magnusson, Achim J. Lilienthal, Henrik Andreasson

For a mobile robot, knowing where you are is everything. This usually involves "registration"—taking a new 3D scan (Lidar or Radar) and lining it up with a previous one or a map. But what happens when the math fails? If a robot blindly trusts a bad alignment, it drifts off course, potentially leading to a collision.

In their paper, "CorAl: Introspection for Robust Radar and Lidar Perception in Diverse Environments Using Differential Entropy," Daniel Adolfsson and his team present a principled way for robots to ask themselves: "Am I actually correctly aligned?"

TL;DR

CorAl (short for "Correctly Aligned?") is a self-supervised method that uses information theory to detect misalignments in Lidar and Radar data. By comparing the "messiness" (differential entropy) of individual scans against their combined union, it identifies even tiny alignment errors across vastly different environments without needing to be retrained.

What Problem Does This Paper Address?

Point cloud registration is the backbone of robot localization, but it’s prone to "local minima"—situations where the algorithm thinks it found a match, but it’s actually slightly off.

The challenge is introspection: the ability of a system to self-assess its performance. Existing metrics for alignment quality are often "brittle." A threshold that works perfectly in a structured office hallway might fail completely in a messy forest or a rainy city street. Furthermore, Radar data—while great for all-weather sensing—is notoriously noisy, making it difficult to extract the clean features needed for traditional quality checks.

Methods

The core of CorAl is built on Information Theory, specifically Differential Entropy.

  1. The Dual Entropy Trick: Instead of just measuring how "blurry" a combined map is, CorAl looks at the entropy of two scans ($P_a$ and $P_b$) separately and then compares them to the entropy of their union ($P_a \cup P_b$).
  2. If the scans are perfectly aligned, the combined entropy should be nearly identical to the individual entropies.
  3. If there is a misalignment, the union becomes "blurry," causing a measurable spike in joint entropy.
  4. RIP-Features for Radar: To make this work for Radar, the authors developed Radar Intensity Peak (RIP) features. This is a two-step filtering process that strips away multi-path reflections and speckle noise, leaving behind stable "landmarks" (like building corners or parked cars) that CorAl can use for a clean entropy calculation.
  5. Self-Supervised Learning: The system doesn't need manual labeling. It takes ground-truth aligned scans and intentionally "breaks" them with small, random offsets to learn what a "bad" alignment looks like versus a "good" one.

Datasets

The authors put CorAl through a gauntlet of diverse environments:

  • ETH Lidar Benchmark: Includes eight sequences ranging from structured indoor environments ("Apartments," "Stairs") to unstructured outdoor ones ("Wood in Autumn").
  • Oxford Radar RobotCar: A massive dataset of urban driving in various weather conditions.
  • MulRan Dataset: Provides diverse radar data from KAIST, including residential areas, mountains, and industrial zones.

Key Insights and Ideas

  • Scene Invariance: By using the difference between joint and separate entropy, CorAl effectively "normalizes" for the environment. It doesn't matter if the scene is inherently complex (high entropy) or simple (low entropy); the metric focuses solely on the change caused by the alignment error.
  • Sensitivity to the "Small Stuff": Most methods can detect a 5-meter error. CorAl is specifically designed to catch the "silent killers"—small errors (e.g., 0.3m) that lead to long-term localization drift.
  • Radar as a Reliable Peer: The paper demonstrates that with proper filtering (RIP), Radar can achieve Lidar-level introspective accuracy, making it viable for safety-critical applications in fog, dust, or heavy rain.

Key Results

  • High Accuracy: CorAl achieved up to 98% accuracy in detecting small alignment errors in urban settings.
  • Superior Generalization: This is the "aha" result. A CorAl model trained on an urban dataset (Oxford) still achieved 96% accuracy when tested on a completely different environment (MulRan) without any retraining.
  • Efficiency: The entire process is computationally light. Feature extraction and quality measurement take less than 5ms on a standard laptop CPU, making it suitable for real-time robotics.
  • Outperforming Baselines: CorAl consistently beat established methods like Mean Map Entropy (MME) and Normal Distributions Transform (NDT) scores, especially in unstructured environments like forests.

Limitations and Future Work

While robust, CorAl does face challenges:

  • Scan Spacing: As the distance between scans increases (and overlap decreases), the "separate entropy" baseline becomes less reliable, causing a drop in accuracy.
  • Radar Beam Divergence: At very long ranges, the physical spread of a radar beam makes objects look different from different angles, which can "trick" the entropy measure into seeing a misalignment where none exists.
  • Dynamic Environments: While the authors note that fast-moving objects don't significantly skew the results, the impact of dense, slow-moving crowds remains an area for further study.

In conclusion, CorAl provides a mathematically grounded "sanity check" for robot perception, moving us one step closer to truly autonomous machines that know when they can—and cannot—trust their own eyes.

Summary updated

Abstract

Robust perception is an essential component to enable long-term operation of mobile robots. It depends on failure resilience through reliable sensor data and preprocessing, as well as failure awareness through introspection, for example the ability to self-assess localization performance. This paper presents CorAl: a principled, intuitive, and generalizable method to measure the quality of alignment between pairs of point clouds, which learns to detect alignment errors in a self-supervised manner. CorAl compares the differential entropy in the point clouds separately with the entropy in their union to account for entropy inherent to the scene. By making use of dual entropy measurements, we obtain a quality metric that is highly sensitive to small alignment errors and still generalizes well to unseen environments. In this work, we extend our previous work on lidar-only CorAl to radar data by proposing a two-stage filtering technique that produces high-quality point clouds from noisy radar scans. Thus we target robust perception in two ways: by introducing a method that introspectively assesses alignment quality, and applying it to an inherently robust sensor modality. We show that our filtering technique combined with CorAl can be applied to the problem of alignment classification, and that it detects small alignment errors in urban settings with up to 98% accuracy, and with up to 96% if trained only in a different environment. Our lidar and radar experiments demonstrate that CorAl outperforms previous methods both on the ETH lidar benchmark, which includes several indoor and outdoor environments, and the large-scale Oxford and MulRan radar data sets for urban traffic scenarios The results also demonstrate that CorAl generalizes very well across substantially different environments without the need of retraining.
BibTeX
@inproceedings{adolfsson2022coral,
  author = {Daniel Adolfsson and Manuel Castellano-Quero and Martin Magnusson and Achim J. Lilienthal and Henrik Andreasson},
  title = {{CorAl: Introspection for robust radar and lidar perception in diverse environments using differential entropy}},
  booktitle = {Robotics Auton. Syst},
  year = {2022},
  url = {https://openreview.net/forum?id=M7MshZRHSF2},
}

Loading related content...

Figure