Predicting Energy Consumption of Ground Robots on Uneven Terrains

Minghan Wei, Volkan Isler

Introduction

For autonomous field robots—deployed in sectors ranging from precision agriculture to search and rescue—battery life is the primary operational constraint. To maximize mission duration and range, these robots must be capable of planning the most energy-efficient paths. This requires an accurate energy-cost map of the environment. However, predicting energy consumption on uneven, off-road terrain is notoriously difficult due to the complex interaction between the robot's drive system and the varying geometry of the ground.

The Limitations of Physics-Based Modeling

Traditionally, researchers have relied on physics-based models that calculate energy consumption using gravity and friction coefficients. While theoretically sound, these models often fail in real-world applications for two main reasons:

  1. Non-Uniformity: Friction coefficients are rarely consistent across a large field, and measuring them at every square inch is logistically impossible.
  2. Directionality: On sloped terrain, energy consumption is highly directional; traversing a hill vertically requires significantly more power than traversing it diagonally or horizontally.

To overcome these hurdles, this research proposes a data-driven approach that predicts energy costs directly from terrain geometry (heightmaps), bypassing the need for manual physical constant measurements.

Methodology: A Vision-Centric Approach

The researchers treat energy prediction as a computer vision problem, utilizing a deep learning pipeline to translate 3D terrain shapes into energy estimates. The process consists of four key stages:

1. Path Segmentation and Patch Extraction

Instead of attempting to predict the energy cost of an entire complex route, the system breaks the path into discrete one-meter segments. For each segment, a $1m \times 1m$ heightmap patch (represented as a $256 \times 256$ matrix) is extracted. This patch captures the specific geometry of the ground where the robot’s wheels will make contact.

2. Directional Normalization

To ensure the model can generalize across any heading, the coordinate system of each heightmap patch is rotated. This normalization ensures the robot is always modeled as moving from the "bottom" to the "top" of the matrix, allowing the neural network to focus on the geometric features relative to the direction of travel.

3. Deep Learning Architecture

The core of the system is a ResNet-18 backbone, originally pretrained on ImageNet. The researchers modified the architecture by replacing the standard classification head with three fully-connected layers. This allows the model to output a single scalar value representing the predicted energy consumption for that specific terrain patch.

4. Total Energy Summation

The total energy required for a full path is calculated by summing the predicted costs of all constituent one-meter segments.

Experimental Evaluation

The model was trained and validated using data collected from a 4WDRoverPro equipped with RTK GPS for centimeter-level positioning and onboard sensors for real-time power monitoring. Data collection occurred across three distinct environments:

  • Primary Site: A $60m \times 40m$ grass area used for initial training.
  • Generalization Site: A separate grass field 2km away to test the model's performance on unseen but similar terrain.
  • New Terrain Class: A dirt playground, used to evaluate the model's ability to transfer knowledge to a different surface type.

Key Results and Insights

High Precision and Generalization

The ResNet-based model achieved an average error rate between 9.1% and 10.9% on the primary grass site. When tested on the generalization site 2km away, the error rate remained impressively low at 12.9%, demonstrating that the model learns fundamental geometric relationships rather than just memorizing a specific field.

Outperforming Baselines

The data-driven approach significantly outperformed traditional physics-based models. While the physics models saw error rates jump to 23.6% in new areas, the ResNet approach maintained its accuracy, representing a more than 10% improvement in prediction reliability.

Rapid Adaptation via Transfer Learning

One of the most significant findings was the model's ability to adapt to entirely new terrain types. When first introduced to dirt, the model's absolute predictions were off (as dirt is more energy-efficient than grass), but its relative ranking of paths remained accurate. With only five minutes of fine-tuning on a small sample of dirt-terrain data, the model's error rate dropped to 9.4%, matching its performance on the original training site.

Conclusion and Future Work

This research demonstrates that local terrain geometry is a highly effective proxy for the complex physical interactions that govern energy consumption. By using 2D heightmap patches, the model captures how terrain width and stability affect resistance in ways that 1D slope vectors cannot.

Currently, the model assumes a constant speed of 0.5 m/s and focuses on navigable surfaces. Future iterations of this work aim to incorporate variable robot velocity and acceleration to account for dynamic maneuvers. Additionally, the researchers plan to integrate aerial imagery from drones, potentially allowing robots to generate energy-cost maps for an entire area before ever setting foot on the ground.

Summary updated

Abstract

Optimizing energy consumption for robot navigation in fields requires energy-cost maps. However, obtaining such a map is still challenging, especially for large, uneven terrains. Physics-based energy models work for uniform, flat surfaces but do not generalize well to these terrains. Furthermore, slopes make the energy consumption at every location directional and add to the complexity of data collection and energy prediction. In this letter, we address these challenges in a data-driven manner. We consider a function which takes terrain geometry and robot motion direction as input and outputs expected energy consumption. The function is represented as a ResNet-based neural network whose parameters are learned from field-collected data. The prediction accuracy of our method is within 12% of the ground truth in our test environments that are unseen during training. We compare our method to a baseline method in the literature: a method using a basic physics-based model. We demonstrate that our method significantly outperforms it by more than 10% measured by the prediction error. More importantly, our method generalizes better when applied to test data from new environments with various slope angles and navigation directions.
BibTeX
@article{wei2022predicting,
  author = {Minghan Wei and Volkan Isler},
  title = {{Predicting Energy Consumption of Ground Robots on Uneven Terrains}},
  journal = {IEEE Robotics Autom. Lett.},
  year = {2022},
  url = {https://openreview.net/forum?id=3P3i7nJ07ke-},
}
Figure