XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision Trees

Aaron M. Roth, Jing Liang, Dinesh Manocha

This blog-style summary provides an overview of the research paper "XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision Trees."

TL;DR

XAI-N (Explainable AI for Navigation) bridges the gap between powerful but opaque deep reinforcement learning and interpretable, rule-based control. By distilling a complex neural network policy into a decision tree, researchers can identify and fix specific failure modes—like "freezing" in front of obstacles or oscillatory "zig-zagging"—without the need for expensive retraining.

What Problem Does This Paper Address?

Deep Reinforcement Learning (DRL) has become a go-to for robot navigation because it handles messy sensor data and dynamic environments well. However, DRL policies are "black boxes." When a robot starts oscillating wildly or "freezes" (stops moving because it can't find a safe path), developers usually have only one option: tweak the reward function and spend hours or days retraining the model, hoping the new version behaves better.

The authors address this lack of interpretability and malleability. They want a way to look "under the hood" of a navigation policy, understand why it’s failing in specific scenarios, and fix those errors directly.

Methods

The XAI-N framework consists of a three-stage pipeline:

  1. Learn an Expert Policy: The authors first train a high-performing navigation policy using Proximal Policy Optimization (PPO), a standard DRL algorithm.
  2. Policy Extraction: Using an algorithm called VIPER, they "distill" the neural network into a Decision Tree (DT). This tree mimics the neural network's behavior but represents it as a series of human-readable "if-then" statements based on sensor inputs.
  3. Policy Modification: This is the core innovation. Because the DT is interpretable, the authors developed specific algorithms to detect and modify "problematic" nodes:
  4. Fixing Freezing: Identifying nodes that command a "stop" action when obstacles are stationary and replacing them with rotation commands to help the robot find an exit.
  5. Fixing Oscillation: Detecting nodes that cause the robot to rapidly switch between left and right turns and splitting them to introduce lower-velocity, smoother actions.
  6. Fixing Blocking: Modifying the tree to ensure the robot doesn't stand in a human's path in social environments.

Datasets

The researchers evaluated XAI-N across three main setups:

  • Mobile Robot Navigation (Simulation): A Gazebo-based environment with static and dynamic obstacles.
  • Warehouse Game Environment: A complex multi-room scenario involving human-following and obstacle avoidance.
  • Real-World Testing: Deployment on a Clearpath Jackal robot navigating among pedestrians to validate the "sim-to-real" transition.
  • State Space: The model uses a 213-dimensional input, including a 210-feature radial occupancy grid derived from LiDAR, goal coordinates, and previous actions.

Key Insights and Ideas

  • The "Aha" Moment for Retraining: The paper demonstrates that we don't always need more data or more training. Often, a policy is 95% correct, and the remaining 5% of "stupid" behaviors can be fixed with surgical logic changes.
  • DTs as a Debugging Tool: Decision trees aren't just for classification; they act as a map of a robot's "reasoning." By looking at which leaf nodes are active during a failure, researchers can pinpoint exactly which sensor configurations lead to bad decisions.
  • Imperfect Imitation can be a Feature: Interestingly, the act of converting a neural net to a decision tree (Stage 2) sometimes naturally smoothed out some oscillations even before the manual fixes were applied.
  • Domain-Specific Customization: XAI-N allows for "safety-first" or "socially-compliant" tweaks that are difficult to guarantee with a pure DRL reward function.

Key Results

The results show that Stage 3 (the modified tree) often outperforms the original "expert" neural network:

  • Oscillation Reduction: In one scenario, the expert DRL policy oscillated in 100% of runs. After the XAI-N fix, this dropped to just 6%, and the average oscillation length plummeted from 8.07m to 1.33m.
  • Eliminating Freezing: A policy that froze in 28% of scenarios was corrected to have a 0% freeze rate.
  • Higher Efficiency: The final XAI-N policy achieved a higher average reward per timestep (0.241) compared to the original PPO expert (0.226), largely because it spent less time stuck or zig-zagging.

Limitations and Future Work

  • Speed Limits: The current logic assumes that dynamic obstacles (like people) do not move significantly faster than the robot itself.
  • Efficiency Trade-offs: The authors noted that fixing "blocking" behavior (staying out of a human's way) increased the total path length from 9.45m to 17.3m. This highlights a classic trade-off between social compliance and raw efficiency.
  • Scaling: While the 213-feature state space is handled well, extremely high-dimensional inputs (like raw camera pixels) would likely require a preprocessing step before they could be used in a readable decision tree.
  • Future Directions: The authors suggest combining XAI-N with traditional motion planners or expanding the library of "fix-it" algorithms for other navigation nuances.

Summary updated

Abstract

We present a novel sensor-based learning navigation algorithm to compute a collision-free trajectory for a robot in dense and dynamic environments with moving obstacles or targets. Our approach uses deep reinforcement learning-based expert policy that is trained using a sim2real paradigm. In order to increase the reliability and handle the failure cases of the expert policy, we combine with a policy extraction technique to transform the resulting policy into a decision tree format. The resulting decision tree has properties which we use to analyze and modify the policy and improve performance on navigation metrics including smoothness, frequency of oscillation, frequency of immobilization, and obstruction of target. We are able to modify the policy to address these imperfections without retraining, combining the learning power of deep learning with the control of domain-specific algorithms. We highlight the benefits of our algorithm in simulated environments and navigating a Clearpath Jackal robot among moving pedestrians. (Videos at this url: https://gamma.umd.edu/researchdirections/xrl/navviper)
BibTeX
@inproceedings{roth2021xai,
  author = {Aaron M. Roth and Jing Liang and Dinesh Manocha},
  title = {{XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision Trees}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2021},
  doi = {10.1109/iros51168.2021.9636759},
}

Loading related content...

Figure