SLEI3D: Simultaneous Exploration and Inspection via Heterogeneous Fleets Under Limited Communication

Junfeng Chen, Yuxiao Zhu, Xintong Zhang, Bing Luo, Meng Guo

TL;DR

This paper introduces SLEI3D, a novel framework for coordinating heterogeneous robot fleets (drones and ground vehicles) to simultaneously explore unknown 3D environments, inspect identified features, and communicate findings back to a mobile ground station, all under strict communication limitations. SLEI3D achieves this through a multi-layer, multi-rate coordination strategy that optimizes exploration, inspection, and communication to minimize mission time.

What Problem Does This Paper Address?

Inspecting large-scale infrastructure like bridges or industrial sites often involves unknown environments and specific features of interest (e.g., cracks, leaks). Traditional approaches either assume known environments or focus solely on exploration, neglecting the critical inspection phase. Furthermore, real-world scenarios frequently suffer from limited or intermittent communication, making it impossible for robots to maintain constant contact with a central control station or each other. This paper tackles the challenge of coordinating a diverse fleet of robots (some good at broad exploration, others at detailed inspection) to efficiently explore, inspect, and report findings in such communication-constrained, unknown environments.

Methods

SLEI3D employs a hierarchical, two-layer coordination framework:

  • Layer 1: GCS-to-SubGroups (Intermittent Communication): A mobile Ground Control Station (GCS) coordinates with subgroups of explorers. This layer uses an intermittent communication protocol, meaning the GCS and explorers meet periodically to exchange information. The GCS dynamically assigns exploration tasks (defined as bounding boxes of interest) to subgroups and receives updates on their progress. A key innovation here is a prediction algorithm for task completion time, enabling the GCS to schedule meetings efficiently and minimize its own waiting time.
  • Layer 2: SubGroups (Proactive Communication): Within each subgroup, an explorer robot coordinates with a team of inspector robots. This layer uses a proactive communication protocol. The explorer, equipped with long-range sensors, identifies areas of interest (AoIs) and assigns them to inspectors with close-range sensors for detailed inspection. The explorer then dynamically plans meeting times and locations with inspectors to collect inspection results and relay them to the GCS. This layer also incorporates adaptive strategies to handle uncertainties and optimize intra-group collaboration.

The framework integrates 3D exploration, inspection, and communication planning, treating them as a unified problem to minimize overall mission time. It also includes mechanisms for handling robot failures and adapting to dynamic environments.

Datasets

Not discussed in the paper. The paper relies on high-fidelity simulations and hardware experiments in custom-built environments.

Key Insights and Ideas

  • Simultaneous Exploration, Inspection, and Communication: The paper demonstrates that these three tasks, often treated separately, can be effectively integrated into a single, optimized framework for improved efficiency.
  • Heterogeneous Fleet Exploitation: SLEI3D effectively leverages the strengths of different robot types (explorers with long-range sensors, inspectors with detailed sensors) to achieve better overall performance than homogeneous fleets.
  • Intermittent and Proactive Communication: The framework's success hinges on intelligently managing limited communication. Intermittent communication between the GCS and subgroups, and proactive communication within subgroups, are crucial for maintaining coordination without constant connectivity.
  • Dynamic Task Allocation and Adaptation: The rolling assignment of exploration tasks (bounding boxes) and the adaptive nature of the exploration and inspection strategies allow the system to cope with unknown environments and unexpected events.
  • Predictive Scheduling: Predicting task completion times is vital for efficient GCS-explorer rendezvous, minimizing idle time for both.

Key Results

  • Scalability: The framework was validated in simulations with up to 48 robots and 384,000 cubic meters of simulated space, demonstrating its ability to handle large-scale missions.
  • Efficiency: SLEI3D achieved the shortest mission completion times compared to six baseline methods across various scenarios, significantly reducing idle time. For instance, in Scenario-C, it collected all features in 1699s, outperforming baselines like CARIC (2659s) and MARL (1648s).
  • Robustness: The system demonstrated robustness to robot failures and communication loss.
  • Hardware Validation: Experiments with 7 robots (UGVs and UAVs) confirmed the practical relevance and feasibility of the proposed framework.
  • Feature Coverage: The system achieved 100% feature coverage in large-scale scenarios.

Limitations and Future Work

  • Communication Models: The paper acknowledges that current communication models are simplified (e.g., LOS constraints) and future work could incorporate more realistic models like NLOS, signal attenuation, and multi-path effects.
  • Exploration Strategies: The authors suggest enhancing exploration efficiency by enabling multi-robot exploration within subgroups, rather than relying on single explorers.
  • Prior Information: While the framework can handle unknown environments, it benefits from prior information like bounding boxes. Future work aims to develop exploration strategies that are fully independent of prior information.
  • Feature Types and Inspector Roles: The framework could be extended to handle more diverse feature types and specialized inspector roles for more complex task requirements.
  • Energy Constraints: While energy constraints were addressed in the paper, further integration and optimization for energy-constrained fleets are suggested.
  • Multi-Robot Exploration within Subgroups: The paper mentions enabling multi-robot exploration within subgroups as a future direction to enhance efficiency.

Summary updated

Abstract

Robotic fleets such as unmanned aerial and ground vehicles have been widely used for routine inspections of static environments, where the areas of interest are known and planned in advance. However, in many applications, such areas of interest are unknown and should be identified online during exploration. Thus, this paper considers the problem of simultaneous exploration, inspection of unknown environments and then real-time communication to a mobile ground control station to report the findings. The heterogeneous robots are equipped with different sensors, e.g., long-range lidars for fast exploration and close-range cameras for detailed inspection. Furthermore, global communication is often unavailable in such environments, where the robots can only communicate with each other via ad-hoc wireless networks when they are in close proximity and free of obstruction. This work proposes a novel planning and coordination framework (SLEI3D) that integrates the online strategies for collaborative 3D exploration, adaptive inspection and timely communication (via the intermittent or proactive protocols). To account for uncertainties w.r.t. the number and location of features, a multi-layer and multi-rate planning mechanism is developed for inter-and-intra robot subgroups, to actively meet and coordinate their local plans. The proposed framework is validated extensively via high-fidelity simulations of numerous large-scale missions with up to 48 robots and 384 thousand cubic meters. Hardware experiments of 7 robots are also conducted. Project website is available at https://junfengchen-robotics.github.io/SLEI3D/.
BibTeX
@article{chen2025slei,
  author = {Junfeng Chen and Yuxiao Zhu and Xintong Zhang and Bing Luo and Meng Guo},
  title = {{SLEI3D: Simultaneous Exploration and Inspection via Heterogeneous Fleets Under Limited Communication}},
  journal = {IEEE Transactions on Automation Science and Engineering},
  year = {2025},
  doi = {10.1109/tase.2025.3643166},
}
Figure