AdVENTR: Autonomous Robot Navigation in Complex Outdoor Environments

Kasun Weerakoon, Adarsh Jagan Sathyamoorthy, Mohamed Elnoor, Dinesh Manocha

TL;DR

AdVENTR is a modular navigation framework that enables both wheeled and legged robots to traverse complex outdoor terrains like tall grass, mud, and rocky slopes. By dynamically switching between specialized perception modules based on the immediate environment, the system optimizes computational efficiency on edge hardware while significantly outperforming standard "one-size-fits-all" navigation stacks.

What Problem Does This Paper Address?

Navigating unstructured outdoor environments is a "perfect storm" of robotics challenges. Unlike indoor settings with flat floors and rigid walls, the outdoors features:

  1. Non-rigid obstacles: Tall grass might look like a wall to a laser scanner, but a robot can safely "plough" through it.
  2. Granular surfaces: Sand, mud, and mulch cause wheel slip and instability that standard geometric planners can't predict.
  3. Computational constraints: Running high-fidelity deep learning models for every possible terrain type simultaneously is often too heavy for a robot's onboard "edge" computer.

Existing systems often fail because they treat all obstacles as rigid or assume uniform traction. AdVENTR tackles this by creating a "scene-aware" system that understands what kind of challenge it is facing and adjusts its perception strategy accordingly.

Methods

The AdVENTR (Adaptive Vegetation, Elevation, aNd Terrain-aware Robot) framework decomposes navigation into a modular pipeline:

  • Scene-aware Switching: This is the core innovation. Instead of running every perception algorithm at once, the system uses lightweight metrics to detect Terrain Unevenness (via elevation gradients), Surface Properties (via PCA analysis of IMU and joint data), and Vegetation (via LiDAR intensity). It then activates only the necessary modules.
  • Specialized Perception Modules:
    • TERP: Analyzes elevation maps to find paths with the least slope/instability.
  • TerraPN/ProNAV: Uses self-supervised learning to correlate visual data with physical "instability" (vibrations/slip) experienced by the robot.
  • VERN: A vision-based classifier that identifies if vegetation is "pliable" (traversable grass) or "stiff" (impassable bushes/trees).
  • Enhanced Planner: The authors extended the standard Dynamic Window Approach (DWA) with a novel objective function. This function doesn't just look for the shortest path; it balances goal progress against costs derived from surface roughness, elevation changes, and vegetation density.
The AdVENTR system architecture showing the flow from sensors to scene-aware switching and final planning.

Datasets

The researchers evaluated the system using real-world data collected from two distinct platforms: a wheeled Clearpath Husky and a legged Boston Dynamics Spot.

  • Training: The underlying perception modules (like TerraPN and VERN) were pre-trained on datasets involving robot-terrain interactions where IMU vibrations and odometry errors served as self-supervised labels.
  • Evaluation: The system was tested across six challenging real-world scenarios, including asphalt with tall grass, uneven sandy pits, and rocky slopes.

Key Insights and Ideas

  • Priority-Based Perception: The system follows a hierarchy (Vegetation > Unevenness > Surface properties). If the robot detects tall grass, it prioritizes the vegetation module because that challenge fundamentally changes how the robot perceives "empty space."
  • Proprioception as a Sensor: By performing Principal Component Analysis (PCA) on IMU data and joint forces, the robot can "feel" the difference between concrete and sand before it even sees the visual difference.
  • Dynamic Gait Adaptation: For legged robots, the system can trigger a switch to more stable gaits when the perception modules detect high-risk surfaces like loose rocks.
PCA analysis showing how different terrains (rocks vs. grass) create distinct clusters in the robot's proprioceptive data.

Key Results

AdVENTR showed dramatic improvements over standalone perception methods and commercial "inbuilt" planners:

  • Success Rates: In Scenario 3 (rocky surface with tall grass), the Spot robot's inbuilt planner had a 0% success rate, treating the grass as an impassable wall. AdVENTR achieved an 80% success rate by identifying the grass as traversable.
  • Stability: Across all tests, AdVENTR consistently resulted in lower "instability costs" (cumulative vibrations), meaning the paths chosen were physically safer for the hardware.
  • Efficiency: In Scenario 1, AdVENTR generated significantly shorter trajectories than surface-only planners by recognizing that cutting through pliable vegetation was more efficient than driving around it on asphalt.
Comparison of navigation trajectories. AdVENTR (red) consistently finds more efficient and successful paths than baselines.

Limitations and Future Work

While robust, AdVENTR has a few hurdles to clear:

  • Environmental Sensitivity: Since modules like VERN rely on RGB images, performance can degrade in low light or heavy motion blur.
  • Geometric Misinterpretation: Low-hanging branches can sometimes be misinterpreted as ground-level obstacles in the elevation map, leading to unnecessary detours.
  • Future Directions: The authors propose integrating Vision Language Models (VLMs) to provide a higher-level semantic understanding of the scene, which could help the robot better generalize to entirely new environments or weather conditions.

Summary updated

Abstract

We present a novel system, AdVENTR for autonomous robot navigation in unstructured outdoor environments that consist of uneven and vegetated terrains. Our approach is general and can enable both wheeled and legged robots to handle outdoor terrain complexity including unevenness, surface properties like poor traction, granularity, obstacle stiffness, etc. We use data from sensors including RGB cameras, 3D Lidar, IMU, robot odometry, and pose information with efficient learning-based perception and planning algorithms that can execute on edge computing hardware. Our system uses a scene-aware switching method to perceive the environment for navigation at any time instant and dynamically switches between multiple perception algorithms. We test our system in a variety of sloped, rocky, muddy, and densely vegetated terrains and demonstrate its performance on Husky and Spot robots.
BibTeX
@inproceedings{weerakoon2023adventr,
  author = {Kasun Weerakoon and Adarsh Jagan Sathyamoorthy and Mohamed Elnoor and Dinesh Manocha},
  title = {{AdVENTR: Autonomous Robot Navigation in Complex Outdoor Environments}},
  booktitle = {ISER},
  year = {2023},
  doi = {10.1007/978-3-031-63596-0\_19},
}

Loading related content...

Figure