Introduction
Unsupervised depth learning has emerged as a powerful alternative to supervised methods, primarily by leveraging "view synthesis" as a supervisory signal. In this framework, a model predicts depth and camera motion to reconstruct one video frame from another, using the reconstruction error as a training loss. However, standard approaches often down-sample images to manage computational costs, leading to three critical failures: the inability to distinguish depth for distant objects, the loss of slim structures like poles, and blurry object boundaries that pose safety risks in autonomous driving.
This paper introduces a dual-network architecture designed to estimate high-resolution depth maps without ground-truth labels. By decoupling global semantic extraction from fine-detail refinement, the proposed method achieves state-of-the-art accuracy on benchmarks like KITTI while maintaining high computational efficiency.
Dual-Network Architecture
The core innovation is a Dual Network architecture that processes visual information at two distinct scales to balance semantic understanding with spatial precision.
- LR-Net (Low-Resolution Network): A deep encoder-decoder that processes $128 \times 416$ images to capture "global semantics," providing the overall structural context of the scene.
- HR-Net (High-Resolution Network): A lightweight, shallow network processing $384 \times 1248$ images. It integrates deep features from the LR-Net with high-resolution inputs to sharpen boundaries and recover fine-grained details.
- SA-Attention (Self-assembled Attention): This module facilitates information sharing between the networks by calculating pixel similarity based on features, color, and spatial distance. This is particularly effective for "low-texture" regions like flat roads where standard matching signals are weak.
- Feature Reconstruction Loss: To enhance supervision, the authors warp deep decoder features rather than relying solely on pixel-matching, providing a more robust signal during training.
Key Insights and Results
The separation of concerns—using deep layers for meaning and shallow layers for edges—allows the model to handle high-resolution data with fewer GFLOPs than a standard deep network. Quantitatively, the dual-network (using a ResNet50 backbone) requires only 25.80 GFLOPs, compared to 33.11 GFLOPs for a standard ResNet18 processing the same high-resolution input.
Performance on KITTI and Generalization
On the KITTI benchmark, the model achieved an Absolute Relative Error (Abs Rel) of 0.121, outperforming previous unsupervised methods. The high-resolution input specifically improved accuracy for objects further than 20 meters away by allowing the model to perceive sub-pixel disparities that are lost at lower resolutions.
Qualitative results highlight the model's ability to reconstruct slim objects like traffic poles, which are typically invisible to unsupervised models. Furthermore, the model demonstrated strong generalization capabilities when tested on the Make3D dataset without any additional fine-tuning.
Conclusion and Future Work
While the dual-network approach significantly advances unsupervised depth estimation, limitations remain. Like most Structure-from-Motion (SfM) based methods, it assumes a static world; dynamic objects like moving cars can still cause depth artifacts. Additionally, reflective and transparent surfaces violate the constant appearance assumption, remaining a challenge for the field. Future work will likely focus on explicitly modeling dynamic objects to enhance robustness for real-world autonomous navigation.
Summary updated