FFA-Net: Feature Fusion Attention Network for Single Image Dehazing

Xu Qin, Zhilin Wang, Yuanchao Bai, Xiaodong Xie, Huizhu Jia

Abstract

In this paper, we propose an end-to-end feature fusion attention network (FFA-Net) to directly restore haze-free images. The FFA-Net architecture consists of three key components: 1) A novel Feature Attention (FA) module that combines Channel Attention with a Pixel Attention mechanism, accounting for the uneven distribution of haze and the varying importance of channel-wise features. 2) A basic block structure incorporating Local Residual Learning and Feature Attention, allowing the network to bypass less important information and focus on effective features. 3) An Attention-based Feature Fusion (FFA) structure where feature weights are adaptively learned, preserving shallow layer information for deeper layers. Experimental results demonstrate that FFA-Net surpasses previous state-of-the-art methods by a significant margin, improving the PSNR metric from 30.23 dB to 36.39 dB on the SOTS indoor test dataset.

Introduction

Single image dehazing is a challenging ill-posed problem. Traditional methods often rely on the atmospheric scattering model, which requires estimating global atmospheric light and transmission maps. While deep learning has advanced this field, early CNN-based models often treated every pixel and channel with equal importance.

In reality, haze distribution is rarely uniform; it varies in thickness across the background and foreground and affects color channels differently. Standard networks struggle with this unevenness, often leaving artifacts in thick haze regions or losing fine details in clearer ones. FFA-Net addresses this by implementing an attention mechanism that allows the model to focus computational power on the most obscured parts of the image.

Architecture and Methodology

FFA-Net moves away from simple pixel-wise regression toward a sophisticated attention-based architecture. It is built upon three main pillars:

  1. Feature Attention (FA) Module: This module combines Channel Attention, which weights feature maps based on importance, and Pixel Attention, which creates a spatial weight map to focus on regions with thicker haze.
  2. Basic Block with Local Residual Learning: The network utilizes blocks that combine the FA module with skip connections. This allows "easy" information (like thin haze or low-frequency areas) to bypass main processing, focusing the network's capacity on more complex image regions.
  3. Attention-based Feature Fusion (FFA): Instead of simple sequential processing, FFA-Net concatenates features from different depths and uses an attention mechanism to adaptively weight them. This ensures critical structural information from shallow layers is retained throughout the deep network.
The FFA-Net architecture, featuring Group Structures (G), Channel Attention (CA), and Pixel Attention (PA).

The final architecture employs three "Group Architectures," each containing 19 "Basic Blocks," creating a deep and highly expressive model for feature extraction and restoration.

Experimental Evaluation

The authors evaluated FFA-Net using the RESIDE (REalistic Single Image DEhazing) benchmark, specifically the Indoor Training Set (ITS) and the Synthetic Objective Testing Set (SOTS).

Quantitative Results

FFA-Net achieved a massive performance leap over previous benchmarks:

  • PSNR: 36.39 dB on the SOTS indoor dataset (compared to the previous best of 30.23 dB).
  • SSIM: 0.9886, indicating near-perfect structural similarity to ground truth images.

Qualitative Results

Visually, the model excels at recovering color fidelity and sharp textures. Unlike earlier models like DCP or AOD-Net, which often produce "ghosting" artifacts or dull images, FFA-Net maintains clarity even in areas previously obscured by thick haze.

Qualitative comparison of dehazing results: (a) Hazy input, (b-d) comparison of different dehazing outputs.

Conclusion

FFA-Net demonstrates that treating pixels and channels unequally is essential for effective single image dehazing. By combining pixel-wise and channel-wise attention with multi-level feature fusion, the network achieves state-of-the-art performance. While the model's depth introduces computational complexity, its success suggests that attention-based fusion is a versatile framework applicable to other low-level vision tasks such as deraining and super-resolution.

Summary updated

Abstract

In this paper, we propose an end-to-end feature fusion at-tention network (FFA-Net) to directly restore the haze-free image. The FFA-Net architecture consists of three key components:1) A novel Feature Attention (FA) module combines Channel Attention with Pixel Attention mechanism, considering that different channel-wise features contain totally different weighted information and haze distribution is uneven on the different image pixels. FA treats different features and pixels unequally, which provides additional flexibility in dealing with different types of information, expanding the representational ability of CNNs. 2) A basic block structure consists of Local Residual Learning and Feature Attention, Local Residual Learning allowing the less important information such as thin haze region or low-frequency to be bypassed through multiple local residual connections, let main network architecture focus on more effective information. 3) An Attention-based different levels Feature Fusion (FFA) structure, the feature weights are adaptively learned from the Feature Attention (FA) module, giving more weight to important features. This structure can also retain the information of shallow layers and pass it into deep layers.The experimental results demonstrate that our proposed FFA-Net surpasses previous state-of-the-art single image dehazing methods by a very large margin both quantitatively and qualitatively, boosting the best published PSNR metric from 30.23 dB to 36.39 dB on the SOTS indoor test dataset. Code has been made available at GitHub.
BibTeX
@inproceedings{qin2020ffa,
  author = {Xu Qin and Zhilin Wang and Yuanchao Bai and Xiaodong Xie and Huizhu Jia},
  title = {{FFA-Net: Feature Fusion Attention Network for Single Image Dehazing}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2020},
  url = {https://openreview.net/forum?id=LuDWLXesy2},
}
Figure