A Practical Causal Framework for Autonomous Mobile Robots: From Simulation to Real-World Human Environments

Luca Castri, Gloria Beraldo, Nicola BellottoarXiv 2026 · arXiv

TL;DR

This paper introduces a practical framework for autonomous robots to navigate human-populated environments by leveraging causal inference. By assuming that the high-level "logic" of cause-and-effect (e.g., time of day causes crowds) is the same in simulation as in reality, the authors demonstrate that a robot can adapt to a new real-world environment in just two minutes, significantly outperforming standard navigation baselines in both safety and success.

What Problem Does This Paper Address?

Deploying robots in busy places like hospitals or airports is a "sim-to-real" nightmare. While we can train robots in simulation for thousands of hours, the real world is messy, unpredictable, and data is expensive to collect.

Causal inference—the ability for a robot to reason about why things happen—is a promising solution for making smarter decisions. However, "causal discovery" (learning the relationships between variables) usually requires massive amounts of data, which is often unsafe or impractical to gather on-site. Users expect robots to work almost immediately, not after a week of observation. This paper tackles the challenge of rapidly transferring causal knowledge from simulation to the physical world with minimal data.

Methods

The authors propose a two-stage "Causal Robot Framework":

  1. Simulation Learning: In a Gazebo-based social simulator (PeopleFlow), the robot learns a causal structure—a directed graph showing how variables like time, location, and obstacles influence crowd density, robot speed, and battery drain. They use a discovery algorithm called J-PCMCI+ to identify these invariant relationships.
  2. Real-World Adaptation: This is the core innovation. Instead of relearning the whole graph from scratch in the real world, the robot assumes the causal structure is invariant. It only needs to update the parameters (the specific probabilities) of that structure.
Figure 1: Framework overview.

By deploying the robot for a brief 2-minute observational phase, the system uses Maximum Likelihood Estimation (MLE) to calibrate the model to the specific "rhythms" of the new environment. This calibrated model is then plugged into an $A^*$ path planner, where the cost of a path isn't just distance, but the causally expected crowd density and energy loss.

Datasets

  • Simulated Data: Generated using the PeopleFlow simulator across four scenarios: a conference poster session, a buffet event, and two airport baggage reclaim settings.
  • Real-World Data: Collected using a TIAGo mobile robot equipped with a 3D LiDAR tracker. The authors recruited 20 volunteers to act out "poster session" and "buffet" scenarios in a physical office building. The adaptation used only 120 seconds of 10Hz data.

Key Insights and Ideas

  • Structural Invariance is the Cheat Code: The most powerful idea here is that while the intensity of a crowd might change between a simulator and a real hallway, the reason for the crowd (e.g., it's lunchtime near the buffet) usually doesn't. By "freezing" the graph and only tuning the numbers, the authors bypass the most computationally expensive part of causal AI.
  • Disentangling Confounders: Standard Bayesian models often fall victim to "spurious correlations." For example, a robot might observe that it uses more battery when it drives slowly and conclude that slow driving causes battery drain. A causal model understands the "hidden" third variable: obstacles. Obstacles cause the robot to slow down and cause battery drain due to frequent maneuvering. Using the do-operator, the robot can simulate "What if I drive at speed $s$?" without being biased by these past observations.
The retrieved causal model (left) shows how context (red) drives system variables (green).

Key Results

  • Rapid Deployment: The framework reduced deployment time by approximately 98.4% compared to a standard pipeline that would require hours of data for full causal discovery.
  • Navigation Success: In real-world tests, the causal planner achieved a 100% completion rate, whereas the shortest-path baseline reached only ~33% because it constantly got stuck in crowds it couldn't "foresee."
  • Safety (Proxemics): The causal planner proactively took detours to avoid human "Social" and "Personal" spaces, consistently maintaining a "Public" distance (>3.6m), while the baseline frequently intruded on people.
  • Efficiency: The system is lightweight enough to run onboard, with an average inference time of just 0.12 seconds per query.
Figure 2: Causal framework: A rapid sim-to-real adaptation calibrates only the conditional probability parameters (green vs. blue histograms), preserving the causal model learned in simulation and enabling efficient robot deployment.

Limitations and Future Work

The authors acknowledge that their real-world trials, while successful, were relatively short. This meant that physical battery depletion was negligible during the tests, so the long-term energy-saving benefits of causal reasoning remain to be fully validated in the field.

Additionally, the current framework assumes the causal structure is completely static. Future work aims to explore online structural adaptation, allowing the robot to "re-wire" its understanding if it encounters a fundamental shift in environmental dynamics that simulation didn't prepare it for.

Summary updated

Abstract

Causal inference has emerged as a powerful paradigm enabling robots to make safe, efficient decisions by reasoning about the ``why'' behind events. However, its real-world application is hindered by the difficulty of collecting causal data, especially in human-populated environments where training takes time, while users expect immediate operation. To this end, we tackle the challenge of transferring simulation-learnt causal relations to the real world with minimal effort. While retaining the invariant high-level causal structure, we empirically demonstrate the system adapts efficiently to real-world situations by updating only the causal model parameters with a limited set of new observations. Our results show that the parameter update enables rapid sim-to-real transfer. The framework runs efficiently onboard of a mobile robot and significantly outperforms a non-causal baselines navigating successfully and safely in complex human-shared scenarios.
BibTeX
@misc{castri2026practical,
  author = {Luca Castri and Gloria Beraldo and Nicola Bellotto},
  title = {{A Practical Causal Framework for Autonomous Mobile Robots: From Simulation to Real-World Human Environments}},
  year = {2026},
  eprint = {2611.04027},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.04027},
}
Figure