Non-Homogeneous Haze Removal via Artificial Scene Prior and Bidimensional Graph Reasoning

Haoran Wei, Qingbo Wu, Hui Li, King Ngi Ngan, Hongliang Li, Fanman Meng, Linfeng Xu

TL;DR

Researchers have developed the Non-Homogeneous Haze Removal Network (NHRN), which tackles the challenge of uneven haze by simulating multiple exposures from a single image and using bidimensional graph reasoning to "borrow" details from clear regions to fix hazy ones. The result is a significant jump in image restoration quality and a boost in performance for downstream tasks like object detection in foggy conditions.

What Problem Does This Paper Address?

Most traditional dehazing algorithms rely on the "atmospheric scattering model," which assumes haze is a uniform blanket over a scene. In reality, haze is often non-homogeneous—it’s patchy, thicker in some spots, and thinner in others.

When haze is uneven, standard models struggle. If an algorithm assumes the haze is thin everywhere, it leaves artifacts in thick regions; if it assumes it's thick, it distorts the clear parts of the image. Furthermore, single-image dehazing is an "ill-posed" problem because we lack depth information. The authors identify two major gaps in current deep learning methods: a lack of scene priors (knowing what the scene should look like) and limited use of contextual information (not using clear parts of the image to help reconstruct hazy parts).

Methods

The authors propose a two-stage architecture called NHRN to solve these issues:

  1. Artificial Scene Prior (AMS Module): Since we don't have multiple photos of the same scene at different exposures (which would help see through different haze densities), the authors create them. They use iterative gamma correction to generate "artificial shots." These shots simulate different exposure levels, revealing textures in hazy regions that were previously obscured. A Gated Fusion (GF) module then intelligently blends these shots to preserve the best details.
  2. Bidimensional Graph Reasoning: This is the "secret sauce." Instead of just using standard local convolutional filters (which only look at neighboring pixels), the network builds a graph.
  3. Spatial Graph Reasoning (SGR): It groups similar pixels (like all patches of grass) into nodes, even if they are far apart in the image. If one patch of grass is clear and another is hazy, the graph allows the network to propagate "clean" information from the clear node to the hazy one.
  4. Channel Graph Reasoning (CGR): This models the dependencies between different feature channels to capture global content-related information like edges and textures.

By combining these, the network can perform "non-local filtering," essentially looking across the entire image to find the best clues for reconstruction.

Datasets

The model was trained and evaluated on a comprehensive suite of datasets:

  • Synthetic: RESIDE (ITS and OTS-β) and DCPDN-data.
  • Real-world Non-Homogeneous: NH-HAZE (the primary benchmark for this specific problem).
  • Real-world Homogeneous: O-HAZE and the DHQ dataset.
  • Downstream Tasks: Foggy Cityscapes-DBF (used to test how well object detection and segmentation work after dehazing).

Key Insights and Ideas

  • The Single Image is its own Prior: By mathematically "stretching" the exposure via gamma correction, the authors prove that a single hazy image contains more structural information than is immediately visible to the eye.
  • Breaking the "Local" Constraint: Standard CNNs are limited by their receptive field. By treating the image as a graph, the NHRN can link a clear pavilion in the foreground to a hazy one in the background, using the former as a blueprint to restore the latter.
  • Beyond Visual Appeal: The paper emphasizes that dehazing isn't just for humans; it's for machines. They show that dehazing significantly reduces "missed detections" for autonomous driving systems operating in fog.

Key Results

The NHRN achieved state-of-the-art (SOTA) results across multiple metrics:

  • Quantitative: On the SOTS dataset, NHRN achieved a 2.46dB gain in PSNR and a 0.0022 gain in SSIM over previous leading methods.
  • Qualitative: Visual results show much better color preservation and fewer "haze artifacts" compared to scattering-model-based methods like DCPDN or end-to-end models like GridNet.
  • Downstream Impact: In object detection tests (using Faster R-CNN), the NHRN-processed images led to the highest mAP (Mean Average Precision) across nine different haze concentrations, proving its utility for real-world computer vision pipelines.

Limitations and Future Work

While powerful, the authors note a few areas for improvement:

  • Computational Redundancy: Generating multiple artificial shots and building graphs is computationally expensive. This might be a bottleneck for real-time video applications.
  • Video Dehazing: The current model processes images frame-by-frame. The authors suggest that future work should explore "temporal redundancy"—using the fact that neighboring frames in a video are highly correlated to make the graph reasoning even more efficient.
  • Parameter Reuse: They aim to explore more flexible ways to reuse parameters in the artificial shot generation to reduce the model's footprint.

Summary updated

Abstract

Due to the lack of natural scene and haze prior information, it is greatly challenging to completely remove the haze from a single image without distorting its visual content. Fortunately, the real-world haze usually presents non-homogeneous distribution, which provides us with many valuable clues in partial well-preserved regions. In this paper, we propose a Non-Homogeneous Haze Removal Network (NHRN) via artificial scene prior and bidimensional graph reasoning. Firstly, we employ the gamma correction iteratively to simulate artificial multiple shots under different exposure conditions, whose haze degrees are different and enrich the underlying scene prior. Secondly, beyond utilizing the local neighboring relationship, we build a bidimensional graph reasoning module to conduct non-local filtering in the spatial and channel dimensions of feature maps, which models their long-range dependency and propagates the natural scene prior between the well-preserved nodes and the nodes contaminated by haze. To the best of our knowledge, this is the first exploration to remove non-homogeneous haze via the graph reasoning based framework. We evaluate our method on different benchmark datasets. The results demonstrate that our method achieves superior performance over many state-of-the-art algorithms for both the single image dehazing and hazy image understanding tasks. The source code of the proposed NHRN is available on <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/whrws/NHRNet</uri> .
BibTeX
@article{wei2021non,
  author = {Haoran Wei and Qingbo Wu and Hui Li and King Ngi Ngan and Hongliang Li and Fanman Meng and Linfeng Xu},
  title = {{Non-Homogeneous Haze Removal via Artificial Scene Prior and Bidimensional Graph Reasoning}},
  journal = {IEEE Trans. Image Process.},
  year = {2021},
  url = {https://openreview.net/forum?id=b-WlfW1X6x},
}

Loading related content...

Figure