SlideSLAM: Sparse, Lightweight, Decentralized Metric-Semantic SLAM for Multirobot Navigation

Xu Liu, Jiuzhou Lei, Ankit Prabhu, Yuezhan Tao, Igor Spasojevic, Pratik Chaudhari, Nikolay Atanasov, Vijay Kumar

TL;DR

This paper introduces SlideSLAM, a novel decentralized metric-semantic SLAM system designed for heterogeneous multi-robot teams. It enables robots to collaboratively build and maintain sparse, lightweight, and informative maps of their environment, crucial for autonomous navigation and exploration in GPS-denied scenarios.

What Problem Does This Paper Address?

Traditional Simultaneous Localization and Mapping (SLAM) systems excel at geometric reconstruction but often struggle with the demands of large-scale, multi-robot operations. These challenges include high computational load, massive storage requirements, and difficulties in merging maps from multiple robots, especially when they have different sensors or operate under intermittent communication. Furthermore, existing SLAM systems often lack semantic understanding, which is vital for robots to interpret their environment and perform high-level tasks. This paper addresses the need for a SLAM system that is not only accurate and efficient but also scalable, decentralized, and capable of building semantically rich maps for heterogeneous robot teams.

Methods

SlideSLAM employs a data-driven front-end for instance segmentation, supporting both RGBD cameras and LiDAR sensors. This front-end extracts semantic object features from sensor data. The core of the system is a custom back-end that optimizes robot trajectories and object landmarks within a sparse, object-level metric-semantic map representation. This sparse representation is key to reducing computational and memory demands, making it suitable for resource-constrained robots.

For multi-robot collaboration, SlideSLAM introduces semantics-driven place recognition algorithms that leverage the object-level map for inter-robot loop closure detection. A decentralized communication module facilitates the sharing of lightweight semantic observations between robots, even under intermittent connectivity. This allows robots to merge their information and collaboratively build a unified map. The system is designed to be modular, allowing for the integration of different object detectors and place recognition algorithms.

Datasets

The paper validates its framework through experiments in both indoor and outdoor environments. It also mentions benchmarks on the Semantic KITTI dataset.

Key Insights and Ideas

  • Sparsity is King for Multi-Robot SLAM: The paper strongly advocates for sparse, object-level map representations over dense point clouds or meshes. This is crucial for reducing communication bandwidth and computational load, enabling efficient collaboration among robots.
  • Semantics as the Glue for Heterogeneity: Leveraging semantic information about objects makes it possible to bridge the gap between robots with different sensors (LiDAR vs. RGBD) and operating in diverse environments. Object landmarks are viewpoint invariant, which is a significant advantage for inter-robot loop closure.
  • Decentralization is Essential for Robustness: The system's decentralized nature means it doesn't rely on a central server, making it more robust to communication failures and individual robot breakdowns.
  • Anytime Performance for Practicality: The proposed place recognition algorithms offer "anytime" performance, meaning they can provide progressively better results as more computation time is allocated, making them suitable for real-time applications.

Key Results

  • Accurate Localization: The SlideGraph algorithm achieved an average position error of 0.13 m and a yaw error of 0.68° in forest environments, and comparable accuracy in urban settings.
  • Efficient Communication: The average communication per landmark is significantly low (e.g., 1.84 KB for outdoor environments), making it suitable for intermittent communication.
  • Robust Multi-Robot Collaboration: Experiments with heterogeneous teams of aerial and ground robots demonstrated successful map merging and collaborative exploration in complex indoor and outdoor scenarios.
  • Real-time Performance: The system is designed to run in real-time onboard resource-constrained robots, with front-end processing (e.g., YOLOv8m) achieving up to 3 Hz and graph optimization taking only a few milliseconds per landmark.

Limitations and Future Work

  • Simplified Object Models: The current map representation uses simplified shapes (cuboids, cylinders, ellipsoids) for objects. While this aids sparsity, it may not capture finer metric details for complex objects, potentially limiting downstream tasks like manipulation. The authors suggest investigating more detailed object representations.
  • Limited Loop Closure Strategy: The current inter-robot loop closure strategy relies on an inlier threshold and doesn't employ a conventional "filtering" approach to select the best loop closure among multiple candidates. Future work will explore more robust consensus-based methods.
  • Handling Dynamic Objects: The current framework assumes static environments. Dynamic objects can violate consistency assumptions and lead to faulty loop closures. The authors propose leveraging semantic knowledge and LLMs to better handle dynamic objects.

Summary updated

Abstract

This paper develops a real-time decentralized metric-semantic Simultaneous Localization and Mapping (SLAM) approach that leverages a sparse and lightweight object-based representation to enable a heterogeneous robot team to autonomously explore 3D environments featuring indoor, urban, and forested areas without relying on GPS. We use a hierarchical metric-semantic representation of the environment, including high-level sparse semantic maps of object models and low-level voxel maps. We leverage the informativeness and viewpoint invariance of the high-level semantic map to obtain an effective semantics-driven place-recognition algorithm for inter-robot loop closure detection across aerial and ground robots with different sensing modalities. A communication module is designed to track each robot's own observations and those of other robots whenever communication links are available. Such observations are then used to construct a merged map. Our framework enables real-time decentralized operations onboard robots, allowing them to opportunistically leverage communication. We integrate and deploy our proposed framework on three types of aerial and ground robots. Extensive experimental results show an average inter-robot localization error of approximately 20 cm in position and 0.2 degrees in orientation, an object mapping F1 score consistently over 0.9, and a communication packet size of merely 2-3 megabytes per kilometer trajectory with as many as 1,000 landmarks. The project website can be found at https://xurobotics.github.io/slideslam/.
BibTeX
@article{liu2025slideslam,
  author = {Xu Liu and Jiuzhou Lei and Ankit Prabhu and Yuezhan Tao and Igor Spasojevic and Pratik Chaudhari and Nikolay Atanasov and Vijay Kumar},
  title = {{SlideSLAM: Sparse, Lightweight, Decentralized Metric-Semantic SLAM for Multirobot Navigation}},
  journal = {IEEE Trans. Robotics},
  year = {2025},
  doi = {10.1109/tro.2025.3629786},
}
Figure