An Experimental-Based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging

Yan Wang, Wei Song, Giancarlo Fortino, Lizhe Qi, Wenqiang Zhang, Antonio Liotta

Introduction: The Challenges of Underwater Vision

Capturing clear images in marine environments is a fundamental challenge for oceanography and underwater robotics. Unlike terrestrial imaging, light in the water medium is subject to intense absorption and scattering by both the water molecules and suspended particles. This results in three primary degradations: significant color cast (where red wavelengths disappear first, leaving a blue-green tint), low contrast due to scattering-induced haze, and non-uniform illumination often caused by artificial light sources in deep-sea exploration.

Physical model of underwater light propagation, illustrating scattering and depth-dependent color absorption.

While numerous algorithms have been proposed to mitigate these effects, the field has historically lacked a unified taxonomy and a rigorous, head-to-head experimental comparison that includes modern deep learning approaches. This paper addresses this gap by providing a comprehensive review and benchmarking state-of-the-art methods against both subjective and objective metrics.

A Unified Taxonomy of Methods

The researchers categorize underwater image processing into two distinct philosophical camps based on their reliance on physical models.

Comprehensive taxonomy of underwater image processing algorithms, distinguishing between IFM-free and IFM-based approaches.

1. IFM-free (Image Enhancement)

These methods treat the image purely as a collection of pixels to be redistributed for better visual quality, without accounting for the physics of light propagation. This category includes:

  • Spatial-domain techniques: Such as Histogram Equalization (HE) and CLAHE.
  • Transform-domain methods: Utilizing wavelets or other frequency-based transforms.
  • CNN-based Enhancement: Deep learning models trained to map degraded images directly to high-quality targets.

2. IFM-based (Image Restoration)

Restoration methods rely on the Underwater Image Formation Model (IFM). They attempt to reverse physical degradation by estimating two critical parameters: Background Light (BL) and the Transmission Map (TM). This group includes "prior-based" methods (e.g., Dark Channel Prior) and CNNs specifically designed to estimate physical water parameters.

Experimental Methodology and Datasets

To ensure a rigorous evaluation, the study utilized several key resources:

  • UIEBD: A large-scale real-world dataset for training and testing CNN models.
  • 300-Image Test Set: Specifically designed to assess the accuracy of Background Light (BL) estimation against a ground truth produced by 15 manual annotators.
  • Challenging Benchmark Set: A curated collection representing four typical conditions: greenish, turbid, low-visibility, and relatively clear scenes.

Key Insights: The Perceptual Gap and the Red Channel Trap

A critical finding of the study is the "Red Channel Trap." Classic dehazing algorithms like the Dark Channel Prior (DCP) often fail underwater because they assume the darkest channel correlates with distance. However, underwater, the red channel is almost always dark due to absorption, not distance, leading to significant restoration errors.

Furthermore, the authors highlight a "perceptual gap" in objective metrics. Metrics like UCIQE and UIQM often reward high contrast and extreme color saturation. Consequently, an algorithm might achieve a high numerical score while producing an image that appears completely unnatural or over-saturated to a human observer.

Comparative Results and Performance

The experimental results revealed a trade-off between information richness and physical accuracy. In the IFM-free category, Histogram Equalization (HE) achieved the highest Entropy (7.8139), yet produced the most visually unnatural results. For restoration, methods like IBLA and ULAP showed the most consistent performance, effectively modeling the specific light attenuation characteristics of water.

While prior-based methods like ULAP and RCP showed improved accuracy in estimating background light compared to traditional DCP, most still struggled to exceed 80% accuracy across all color channels, indicating a significant bottleneck in current restoration pipelines.

Conclusion and Future Directions

Despite recent progress, no single algorithm currently generalizes across all underwater environments, such as varying depths or the transition from salt to fresh water. Future research must address the "Deep-Sea Gap," where artificial light creates extreme non-uniformity that current models fail to account for. Additionally, there is a pressing need for more efficient models capable of real-time processing on autonomous underwater vehicles (AUVs) and a shift toward evaluating how enhancement impacts high-level tasks like robotic navigation and object detection.

To support the community, the authors have released their evaluation framework and standardized "sandbox" on GitHub.

Summary updated

Abstract

Underwater images play a key role in ocean exploration, but often suffer from severe quality degradation due to light absorption and scattering in water medium. Although major breakthroughs have been made recently in the general area of image enhancement and restoration, the applicability of new methods for improving the quality of underwater images has not specifically been captured. In this paper, we review the image enhancement and restoration methods that tackle typical underwater image impairments, including some extreme degradations and distortions. Firstly, we introduce the key causes of quality reduction in underwater images, in terms of the underwater image formation model (IFM). Then, we review underwater restoration methods, considering both the IFM-free and the IFM-based approaches. Next, we present an experimental-based comparative evaluation of state-of-the-art IFM-free and IFM-based methods, considering also the prior-based parameter estimation algorithms of the IFM-based methods, using both subjective and objective analysis (the used code is freely available at https://github.com/wangyanckxx/Single-Underwater-Image-Enhancement-and-Color-Restoration). Starting from this study, we pinpoint the key shortcomings of existing methods, drawing recommendations for future research in this area. Our review of underwater image enhancement and restoration provides researchers with the necessary background to appreciate challenges and opportunities in this important field.
BibTeX
@article{wang2019experimental,
  author = {Yan Wang and Wei Song and Giancarlo Fortino and Lizhe Qi and Wenqiang Zhang and Antonio Liotta},
  title = {{An Experimental-Based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging}},
  journal = {IEEE Access},
  year = {2019},
  doi = {10.1109/access.2019.2932130},
}

Loading related content...

Figure