Event-based SLAM Benchmark for High-Speed Maneuvers

Sheng Zhong, Junkai Niu, Guillermo Gallego, Kaizhen Sun, Yang Yi, Zhiqiang Miao, Dewen Hu, Yaonan Wang, Davide Scaramuzza, Yi ZhouarXiv 2026 · arXiv

TL;DR

While event cameras promise motion-blur-free tracking for high-speed robotics, current SLAM benchmarks fail to simulate true, aggressive 6-DoF maneuvers. This paper introduces EvSLAM, a comprehensive benchmarking framework featuring a diverse VGA-resolution stereo event dataset collected across four distinct robotic platforms. The authors uncover critical flaws in existing public datasets—such as severe stereo data inconsistencies caused by lens defocus—and provide a rigorous evaluation of state-of-the-art event-based algorithms.

What Problem Does This Paper Address?

Visual Simultaneous Localization and Mapping (vSLAM) is essential for autonomous robots, but standard frame-based cameras fail under aggressive motion (due to motion blur) or extreme lighting (due to under/over-exposure). Event cameras solve this by asynchronously reporting pixel-level brightness changes at microsecond resolution with a dynamic range exceeding 120 dB.

However, the authors argue that the potential of event-based SLAM hasn't been fully unlocked because current datasets suffer from three major shortcomings:

  1. Spatio-Temporal Inconsistency: Many public datasets exhibit massive event count mismatches (up to 86%) between the left and right cameras in a stereo setup.
  2. Lack of True High-Speed Maneuvers: Datasets claiming to feature "high-speed" motion often have large scene depths, meaning the image velocity (optical flow) is actually very low, resulting in zero motion blur.
  3. The Megapixel Race: Moving to HD event sensors causes a superlinear explosion in data rates and introduces cluttered, non-discriminative events (the "Kirschbaum" problem), overwhelming real-time processing pipelines.
Fig. 4: Is existing data really from high-speed scenarios? Comparison of resolution-normalized optical flow distributions for partial sequences across different datasets.

Methods

To address these challenges, the authors developed a rigorous hardware and algorithmic framework:

  • Active Stereo Focusing Strategy: To fix the left-right event mismatch, they introduced a method that monitors real-time event counts while displaying a flickering checkerboard pattern, adjusting the lens focus rings until event rates maximize and match perfectly.
  • Multi-Platform Data Collection: They designed a rigid, lightweight sensor suite containing a stereo event camera (DVXplorer, 640×480 resolution, 10 cm baseline), an Intel RealSense D435 (stereo grayscale + color), and a high-frequency IMU.
  • Weighted Velocity Metric: Standard SLAM metrics like Absolute Trajectory Error (ATE) treat all tracking errors uniformly. The authors propose a novel metric, the Area Under the Curve (AUC) of a weighted Relative Velocity Error ($S(\xi)$), which weights high-speed segments more heavily to fairly evaluate a system's operational limits during aggressive maneuvers.

Datasets

The authors introduced the EvSLAM Dataset, which includes multiple sequences recorded indoors using high-precision Motion Capture (MoCap) systems for ground truth. The data spans four distinct robotic platforms to capture varied motion profiles:

  • FPV Drone: Aggressive 6-DoF motion.
  • Linear Slider: Pure translation.
  • Robotic Arm: Large-angle, high-frequency oscillations.
  • Mecanum-wheel Vehicle: Rapid, agile rotations.

The dataset includes both standard lighting and complex low-light/HDR scenarios.

Fig. 1: We present an event-based SLAM benchmark for high-speed maneuvering scenarios. Left: The multi-camera sensor suite is mounted on four mobile robotic platforms (drone, linear slider, robotic arm, and Mecanum-wheel vehicle) for data collection. Right: Visualizations of grayscale images, event streams (in red-blue according to event polarity), and optical flow magnitudes (pseudocolored as a heatmap) in high-speed maneuvering and HDR scenarios.

Key Insights and Ideas

  • Defocus is the Hidden Enemy: The paper reveals that slight lens defocus acts as a low-pass filter, severely reducing the contrast gradients needed to trigger events. This is the primary driver behind the stereo event count inconsistencies found in popular datasets like DSEC and MVSEC.
  • VGA is the Sweet Spot: Through depth-error and data-rate analysis, the authors demonstrate that 640×480 (VGA) resolution provides the optimal trade-off between spatial detail and computational efficiency for real-time SLAM. Higher resolutions trigger cluttered events that degrade tracking and break real-time constraints.
  • The High-Speed HDR Paradox: While event cameras excel in high-speed or HDR conditions individually, their performance degrades significantly when these conditions occur simultaneously. High-speed motion in HDR environments generates massive amounts of background noise, obscuring structural event edges.
Fig. 3: Inconsistencies in stereo data. Comparison of left and right event time maps, showing regions with particularly noticeable differences (red boxes). The corresponding images are provided for visualization purposes only.

Key Results

The authors benchmarked 9 state-of-the-art methods (including model-based direct/indirect, deep learning-based, and frame-based approaches):

  • Event-Frame Fusion Wins: Methods that fuse events and frames (like SuperEvent and ESVIO) consistently achieved the lowest tracking errors. For example, on the highly challenging arm_norm sequence, event-frame fusion methods maintained stable tracking where frame-only methods suffered from motion blur.
  • Learning-Based Robustness: Deep learning-based event methods (like SDEVO and DEIO) generalized remarkably well to aggressive motions without requiring extensive manual parameter tuning, though they struggled in the noisy high-speed HDR sequences.
  • IMU Smoothing: Integrating IMU constraints significantly improved the smoothness and accuracy of linear velocity estimation, yielding much higher AUC scores on aggressive drone trajectories.

Limitations and Future Work

Despite the promise of learning-based event SLAM, current state-of-the-art networks heavily rely on high-end desktop GPUs (e.g., RTX 4080), making them impractical for power-constrained edge devices like micro-drones. Furthermore, most current architectures still force event data into conventional frame-based pipelines (generating artificial event frames). The authors conclude that the field must shift toward developing lightweight networks and true continuous-time, asynchronous optimization back-ends to fully exploit the microsecond temporal resolution of event sensors.

Summary updated

Abstract

Event-based cameras are bio-inspired sensors with pixels that independently and asynchronously respond to brightness changes at microsecond resolution, offering the potential to handle visual tasks in high-speed maneuvering scenarios. Existing event-based approaches, although successful in mitigating motion blur caused by high-speed maneuvers, suffer from many limitations. Some of them highlight a success of pose tracking for a fronto-parallel fast shaking camera closed to the structure, while others assume pure (optionally aggressive) three-degree-of-freedom rotations. The former requires persistent local map visibility within the field of view (FOV), whereas the latter fails to generalize to six-degree-of-freedom (6-DoF) motions where both linear and angular velocities may be large. Consequently, current successes do not fully demonstrate that event-based state estimation under arbitrary aggressive maneuvers is a fully solved problem. To quantitatively assess the extent to which the potential of event cameras has been unlocked, we conduct a thorough analysis of state-of-the-art (SOTA) event-based visual odometry (VO)/visual-inertial odometry (VIO) methods and report shortcomings in current public datasets. Furthermore, we introduce a benchmarking framework for event-based state estimation, called EvSLAM, characterized by sufficient variation in data collection platforms, diverse extreme lighting scenarios, and a wide scope of challenging motion patterns under a clear and rigorous definition of high-speed maneuvers for mobile robots, along with a novel evaluation metric designed to fairly assess the operational limits of event-based solutions. This framework benchmarks state-of-the-art methods, yielding insights into optimal architectures and persistent challenges.
BibTeX
@misc{zhong2026event,
  author = {Sheng Zhong and Junkai Niu and Guillermo Gallego and Kaizhen Sun and Yang Yi and Zhiqiang Miao and Dewen Hu and Yaonan Wang and Davide Scaramuzza and Yi Zhou},
  title = {{Event-based SLAM Benchmark for High-Speed Maneuvers}},
  year = {2026},
  eprint = {2604.24033},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2604.24033},
}

Loading related content...

Figure