Block-Greedy and CNN Based Underwater Image Dehazing for Novel Depth Estimation and Optimal Ambient Light

Fayadh Alenezi, Ammar Armghan, Sachi Nandan Mohanty, Rutvij H. Jhaveri, Prayag TiwariWater 2021 · DOI

TL;DR

This paper introduces a novel Convolutional Neural Network (CNN) approach for underwater image dehazing that leverages a "block-greedy" algorithm to estimate optimal ambient light and scene depth. By focusing on pixel differences across color channels and incorporating a Markov Random Field for edge smoothing, the method significantly improves image clarity, color balance, and sharpness compared to existing techniques.

What Problem Does This Paper Address?

Underwater environments are notoriously challenging for image capture due to light scattering and absorption by water and suspended particles. This results in images that are often hazy, color-distorted, and lack contrast, hindering their usefulness in various applications like surveillance and environmental monitoring. Existing underwater image dehazing methods often struggle with accurately estimating global background light and can lead to issues like color over-saturation or blurred details. This paper aims to address these shortcomings by developing a more robust and accurate dehazing technique specifically tailored for underwater imagery.

Methods

The core of the proposed method is a novel Convolutional Neural Network (CNN) architecture. Key innovations include:

  • Block-Greedy Algorithm: This algorithm is central to estimating both the scene depth and the optimal ambient light. It intelligently selects pixels from local and global patches by analyzing pixel differences across color channels (red, green, blue) and their variance. This approach aims to overcome limitations of previous methods that might make simplifying assumptions about pixel homogeneity.
  • Pixel Discontinuity Correction: Underwater images often suffer from pixel discontinuities. The proposed method addresses this by transforming local and global pixel values to ensure continuity, thereby improving accuracy and preserving color hue.
  • Markov Random Field (MRF) for Energy Minimization: A novel MRF-based minimum cost function is employed to smooth edges and enhance image features. This is optimized using a graph cut approach, which helps prevent over-smoothing and maintains sharp boundaries.
  • Multi-Module CNN Architecture: The CNN is composed of three main modules:
  • Global and Local Light Network: Estimates both global and local ambient light.
  • Depth Estimation Network: Leverages pixel differences (as described above) to estimate scene depth.
  • A-Estimator: Restores the final dehazed image using the estimated depth and ambient light.

Datasets

The paper states that the image dataset used for training and evaluation was obtained from existing state-of-the-art papers. Specific datasets are not detailed, but the evaluation uses 32 underwater images.

Key Insights and Ideas

  • Focus on Pixel Differences: The insight that analyzing pixel differences across color channels (red, green, blue) and their variance is crucial for accurate scene depth estimation and ambient light calculation is a key contribution. This moves beyond simpler assumptions about image properties.
  • Block-Greedy for Optimal Selection: The block-greedy approach for selecting the most informative pixels (lowest variance) from local and global patches is a novel way to refine ambient light estimation, avoiding reliance on arbitrary percentages of bright pixels.
  • MRF for Controlled Smoothing: Using an MRF with graph cuts to smooth edges is a clever way to balance feature enhancement with artifact reduction, preventing over-saturation and maintaining clarity.
  • Holistic CNN Design: The integration of dedicated modules for ambient light, depth estimation, and final image restoration within a single CNN architecture allows for a more cohesive and effective dehazing process.

Key Results

The proposed method demonstrates superior performance compared to existing state-of-the-art underwater dehazing algorithms across several evaluation metrics:

  • Quantitative Improvements: The paper reports percentage improvements over the best existing techniques:
  • Entropy: 0.4%
    • UCIQE: 4.8%
    • UIQM: 9.7%
    • UICM: 5.1%
    • UISM: 7.2%
  • Qualitative Improvements: Dehazed images are described as sharp, colorful, and clear, with better detail extraction and color balance. The method is noted for producing more transparent images with more permanent colors and sharper edges.
  • Consistency: Stable standard deviation (σ) values across metrics indicate consistent performance.

Limitations and Future Work

  • Underwater Specificity: The primary limitation acknowledged is that the proposed technique is currently only applicable to underwater images.
  • Blue Region Over-Saturation: The paper notes that the blue region can sometimes be over-saturated, which is attributed to the reliance on mean absolute differences between color channels, particularly when blue is a dominant color.
  • Future Work Suggestions:
    • Investigate edge strengthening without color saturation during depth estimation.
  • Adapt the algorithm for natural dehaze images with minor modifications to account for the absence of water-specific optical properties.

Summary updated

Abstract

A lack of adequate consideration of underwater image enhancement gives room for more research into the field. The global background light has not been adequately addressed amid the presence of backscattering. This paper presents a technique based on pixel differences between global and local patches in scene depth estimation. The pixel variance is based on green and red, green and blue, and red and blue channels besides the absolute mean intensity functions. The global background light is extracted based on a moving average of the impact of suspended light and the brightest pixels within the image color channels. We introduce the block-greedy algorithm in a novel Convolutional Neural Network (CNN) proposed to normalize different color channels’ attenuation ratios and select regions with the lowest variance. We address the discontinuity associated with underwater images by transforming both local and global pixel values. We minimize energy in the proposed CNN via a novel Markov random field to smooth edges and improve the final underwater image features. A comparison of the performance of the proposed technique against existing state-of-the-art algorithms using entropy, Underwater Color Image Quality Evaluation (UCIQE), Underwater Image Quality Measure (UIQM), Underwater Image Colorfulness Measure (UICM), and Underwater Image Sharpness Measure (UISM) indicate better performance of the proposed approach in terms of average and consistency. As it concerns to averagely, UICM has higher values in the technique than the reference methods, which explainsits higher color balance. The μ values of UCIQE, UISM, and UICM of the proposed method supersede those of the existing techniques. The proposed noted a percent improvement of 0.4%, 4.8%, 9.7%, 5.1% and 7.2% in entropy, UCIQE, UIQM, UICM and UISM respectively compared to the best existing techniques. Consequently, dehazed images have sharp, colorful, and clear features in most images when compared to those resulting from the existing state-of-the-art methods. Stable σ values explain the consistency in visual analysis in terms of sharpness of color and clarity of features in most of the proposed image results when compared with reference methods. Our own assessment shows that only weakness of the proposed technique is that it only applies to underwater images. Future research could seek to establish edge strengthening without color saturation enhancement.
BibTeX
@inproceedings{alenezi2021block,
  author = {Fayadh Alenezi and Ammar Armghan and Sachi Nandan Mohanty and Rutvij H. Jhaveri and Prayag Tiwari},
  title = {{Block-Greedy and CNN Based Underwater Image Dehazing for Novel Depth Estimation and Optimal Ambient Light}},
  booktitle = {Water},
  year = {2021},
  doi = {10.3390/w13233470},
}
Figure