A Vision-based Irregular Obstacle Avoidance Framework via Deep Reinforcement Learning

Lingping Gao, Jianchuan Ding, Wenxi Liu, Haiyin Piao, Yuxin Wang, Xin Yang, Baocai Yin

TL;DR

This paper introduces a vision-based framework that transforms a single RGB image into "pseudo-laser" data to help robots navigate around tricky, irregular obstacles like tables and chairs. By combining depth estimation with semantic segmentation and a novel "deep slicing" technique, the authors enable deep reinforcement learning (DRL) agents to achieve high-performance collision avoidance with a significantly reduced sim-to-real gap.

What Problem Does This Paper Address?

Traditional robot navigation often relies on 1D laser scanners (LiDAR). While fast and accurate, these sensors have a fatal flaw: they only "see" a thin horizontal slice of the world. If a laser is mounted 20cm off the ground, it might detect a table's legs but completely miss the overhanging tabletop, leading to a collision.

On the other hand, using full RGB images for navigation introduces a massive "sim-to-real" gap—it is incredibly difficult to train a robot in a simulator and have its visual processing work perfectly in the messy real world. RGB-D cameras (which provide depth) are an alternative, but they are expensive and often fail in direct sunlight or when facing non-reflective materials like black metal. This paper seeks a middle ground: the richness of vision with the simplicity and robustness of laser-like data.

Methods

The authors propose a multi-stage pipeline to generate pseudo-laser data:

  1. Vision Processing: A single RGB image is passed through two parallel branches: FastDepth for depth estimation and CCNet for semantic segmentation.
  2. Semantic Masking: The framework uses the semantic map to identify "traversable regions" (like the floor). It then masks these out of the depth map so the robot doesn't mistake the ground for an obstacle.
  3. Deep Slicing (Dynamic Local Minimum Pooling): Instead of taking a single horizontal slice of the depth map, the authors perform column-wise minimum pooling on the bottom half of the image. This ensures that the "pseudo-laser" represents the closest obstacle in any given direction, regardless of its height.
  4. DRL Decision Module: This 1D data is fed into a Deep Reinforcement Learning model (using the PPO algorithm). The architecture includes an Attention mechanism to focus on salient obstacles and an LSTM (Long Short-Term Memory) layer to help the robot "remember" objects that might have rotated out of its 90° field of view.
  5. Adaptive Noise: To further bridge the sim-to-real gap, the authors adaptively add noise to the training data, emulating the measurement errors common in real-world depth estimation.

Datasets

  • Pre-training: The depth estimation and semantic segmentation models were trained on the NYU (indoor) and KITTI (outdoor) datasets.
  • Simulation: Training and evaluation were conducted in custom-built environments using the Stage (2D) and Gazebo (3D) simulators, featuring complex corridors and irregular obstacles.
  • Real-world: The model was deployed and tested on a physical ROS-based mobile robot equipped with Intel RealSense cameras.

Key Insights and Ideas

  • Dimensionality Reduction with a Purpose: The "pseudo-laser" is a clever way to perform dimensionality reduction. It strips away the "redundant" visual data (colors, textures) that causes sim-to-real failures while keeping the spatial information necessary for safety.
  • The "Tabletop" Solution: By using minimum pooling across the vertical columns of the depth map, the system effectively "flattens" 3D obstacles into a 1D safety map. If any part of a table (legs or top) is close, it shows up in the pseudo-laser.
  • Semantics Matter for Navigation: Pure depth maps can be fooled by slopes or shadows. By incorporating semantic segmentation, the robot can distinguish between a "floor with a shadow" (safe) and "water on the floor" (unsafe), treating the latter as an obstacle.

Key Results

  • Superiority over LiDAR: In "Scene 7" (filled with irregular objects), traditional laser-based models had a success rate of only 15–21%. The proposed vision-based framework achieved an 89% success rate.
  • Robustness to FOV: Even with a limited 90° field of view (compared to the standard 180° laser), the inclusion of LSTM and Attention allowed the model to maintain high success rates (94-100% in standard test scenes) by leveraging temporal memory.
  • Real-world Success: The authors successfully migrated the policy from simulation to a physical robot, proving that the pseudo-laser representation effectively minimizes the sim-to-real gap.

Limitations and Future Work

The authors acknowledge a few key weaknesses:

  • Mirrors and Glass: The current depth estimation methods (FastDepth) struggle with reflective surfaces like mirrors, which can lead to navigation failures.
  • Computational Load: While faster than processing raw video, the pipeline still requires a decent GPU (tested on a GTX 1080Ti) to maintain 10 frames per second.
  • Global Context: The current framework focuses on local obstacle avoidance. Future work aims to integrate this with global positioning and more complex "pure vision" concepts like robot self-positioning.

Summary updated

Abstract

Deep reinforcement learning has achieved great success in laser-based collision avoidance work because the laser can sense accurate depth information without too much redundant data, which can maintain the robustness of the algorithm when it is migrated from the simulation environment to the real world. However, high-cost laser devices are not only difficult to apply on a large scale but also have poor robustness to irregular objects, e.g., tables, chairs, shelves, etc. In this paper, we propose a vision-based collision avoidance framework to solve the challenging problem. Our method attempts to estimate the depth and incorporate the semantic information from RGB data to obtain a new form of data, pseudo-laser data, which combines the advantages of visual information and laser information. Compared to traditional laser data that only contains the one-dimensional distance information captured at a certain height, our proposed pseudo-laser data encodes the depth information and semantic information within the image, which makes our method more effective for irregular obstacles. Besides, we adaptively add noise to the laser data during the training stage to increase the robustness of our model in the real world, due to the estimated depth information is not accurate. Experimental results show that our framework achieves state-of-the-art performance in several unseen virtual and real-world scenarios.
BibTeX
@inproceedings{gao2021vision,
  author = {Lingping Gao and Jianchuan Ding and Wenxi Liu and Haiyin Piao and Yuxin Wang and Xin Yang and Baocai Yin},
  title = {{A Vision-based Irregular Obstacle Avoidance Framework via Deep Reinforcement Learning}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2021},
  doi = {10.1109/iros51168.2021.9636512},
}

Loading related content...

Figure