Obstacle detection by ground homograph estimation during autonomous navigation

Yuan Gao, Jiayi Ma, Wenjuan Jiang, Jinwen TianProceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE 2011 · DOI

TL;DR

This paper proposes an iterative framework for obstacle detection in autonomous navigation that leverages the duality between ground homograph estimation and obstacle localization. By iteratively refining both estimates, the method achieves robust obstacle detection without requiring camera calibration parameters.

What Problem Does This Paper Address?

Autonomous navigation systems, particularly for vehicles and robots, critically rely on accurately detecting and localizing obstacles. Traditional methods often require precise camera calibration, which can be cumbersome and prone to errors. Furthermore, accurately distinguishing between the ground plane and obstacles, especially in complex or uneven terrain, remains a significant challenge. This paper aims to address these issues by developing a robust and flexible obstacle detection system that is independent of camera intrinsic parameters and can handle variations in the ground surface.

Methods

The core of the proposed method is an iterative framework that exploits the relationship between ground homography and obstacle detection. The process begins with an initial estimation of the ground homograph using feature point correspondences between image pairs. This homograph is then used to generate a "homograph disparity image" (HDI) by differencing the warped images. Regions with significant disparities in the HDI are likely to be obstacles.

The key innovation lies in the iterative refinement:

  1. Feature Point Extraction and Initial Homograph Estimation: SIFT features are extracted, and a robust matching algorithm (Victor Field Consensus - VFC) is used to find reliable correspondences. An initial homograph is estimated from these inlier matches.
  2. Homograph Disparity Image (HDI) Generation: The estimated homograph is used to warp one image to align with the other. The absolute difference between the warped and original images creates the HDI, highlighting deviations from the ground plane.
  3. Obstacle Segmentation: Felzenszwalb's efficient graph-based image segmentation algorithm is applied to the HDI to identify homogeneous regions, which are then classified as potential obstacles.
  4. Iterative Refinement: Crucially, feature points identified as belonging to obstacle regions are removed from the set used for homograph estimation in the next iteration. This prevents obstacles from influencing the ground homograph estimation. The process repeats, re-estimating the homograph with the refined feature set, generating a new HDI, and re-segmenting obstacles. This cycle continues until convergence, typically achieved within two to four iterations.

This iterative approach allows the system to gradually "filter out" the ground plane and progressively isolate obstacles, improving the accuracy of both the homograph and the obstacle localization.

Datasets

The paper describes experiments conducted on "real images." No specific named datasets are mentioned or introduced.

Key Insights and Ideas

  • Duality of Obstacle Detection and Ground Homography: The paper effectively leverages the reciprocal relationship: a good ground homograph helps detect obstacles, and knowing obstacle locations helps refine the ground homograph.
  • Camera Parameter Independence: A significant advantage is the ability to perform obstacle detection without needing camera intrinsic parameters (focal length, principal point, distortion coefficients). This simplifies deployment and reduces calibration overhead.
  • Iterative Refinement for Robustness: The iterative process is key. By progressively removing obstacle points from the homograph estimation, the algorithm avoids self-contamination and converges to a more accurate representation of both the ground and the obstacles.
  • Homograph Disparity Image (HDI): This intermediate representation effectively visualizes deviations from the estimated ground plane, making obstacle regions stand out.
  • Ground Undulation Tolerance: The analysis suggests that the method is relatively tolerant to minor ground undulations, treating the ground as approximately planar, which is a reasonable assumption for many autonomous navigation scenarios.

Key Results

The paper presents qualitative results demonstrating the effectiveness of the iterative algorithm. Figure 3 shows the step-by-step process, illustrating how the initial HDI, which shows significant texture from the ground, becomes cleaner and more focused on obstacles after the iterative refinement. Figure 4 shows final obstacle localization results on various images, highlighting detected obstacles with bounding boxes. The authors state that the algorithm "can gain robust results for obstacle detection" and that it "can work quite well" when the background is approximately planar. They also provide a theoretical analysis showing that for typical parameters, ground undulations of less than 0.1m result in a disparity change of less than half a pixel, which is often negligible.

Limitations and Future Work

  • Assumption of Planar Ground: The method assumes the ground is approximately planar. While the analysis shows some tolerance to undulation, significant non-planar ground surfaces (e.g., steep slopes, ditches) might pose challenges.
  • Computational Cost: While the iterative process converges quickly (2-4 iterations), the repeated feature extraction, matching, homograph estimation, and segmentation might still be computationally intensive for real-time applications on resource-constrained platforms.
  • Dependence on Feature Points: The accuracy of the homograph estimation and subsequent obstacle detection relies on the presence and quality of distinctive feature points in the images. Sparse or texture-less environments could be problematic.

Future work could involve extending the method to handle more complex ground surfaces, optimizing the computational efficiency for real-time deployment, and exploring its application in dynamic environments with moving obstacles.

Summary updated

Abstract

In this paper, a simple and flexible framework based on the duality of obstacle detection and ground homograph estimation is proposed for obstacle detecting during autonomous navigation. The virtue of which is that the obstacle can be detected and localized without requiring the parameters of the camera. The iterative frame is implemented in our method to avoid the influence of the obstacles when estimating the ground homography. We initially estimate a homograph for the ground using matching points to register the image pairs; then, the two images are differenced so that the homograph disparity image (HDI) can be generated; after that, we segment the HDI to obtain a coarse location of obstacles; and the matching points out of the obstacle regions will be considered as input for the latter loop. This process is iterated until the results converge. The feasibility of this scheme is analyzed, and the experimental results demonstrate it can gain robust results for obstacle detection.
BibTeX
@inproceedings{gao2011obstacle,
  author = {Yuan Gao and Jiayi Ma and Wenjuan Jiang and Jinwen Tian},
  title = {{Obstacle detection by ground homograph estimation during autonomous navigation}},
  booktitle = {Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE},
  year = {2011},
  doi = {10.1117/12.901206},
}
Figure