Adaptation Strategies for Applying AWGN-Based Denoiser to Realistic Noise

Yuqian Zhou, Jianbo Jiao, Haibin Huang, Jue Wang, Thomas S. Huang

Introduction

Deep learning-based image denoising has seen significant progress, yet a persistent gap remains between performance on synthetic datasets and real-world digital photography. Most state-of-the-art models, such as DnCNN, are trained on Additive White Gaussian Noise (AWGN). However, real camera noise is complex, signal-dependent, and spatially variant. This paper proposes a framework to bridge this gap by combining an explicit noise estimator with an adaptive denoiser.

Figure 1: Input image with synthetic noise, showing the challenge of preserving detail while removing grain.

Methodology: The Two-Stage Framework

The proposed architecture consists of two primary components: a Noise Estimator ($N_{es}$) and an Adaptive Denoiser ($R_{es}$).

Noise Estimation ($N_{es}$)

Rather than assuming a uniform noise level, $N_{es}$ predicts pixel-wise noise level maps. These maps represent both AWGN and Random Value Impulse Noise (RVIN) across RGB channels. This spatial awareness allows the model to handle non-homogeneous noise common in real-world sensors.

Adaptive Denoising ($R_{es}$)

The denoiser is a 20-layer residual network that accepts both the noisy image and the estimated noise maps as input. By treating the problem as a non-blind denoising task guided by $N_{es}$, the model can specifically target different noise components more effectively.

Adaptation Strategies for Real-World Noise

To adapt models trained on synthetic data to real-world scenarios, the authors introduce two innovative techniques:

  1. Pixel-Shuffle Subsampling: Real-world noise often exhibits spatial correlation. By subsampling the image with varying strides (pixel-shuffling), the authors "normalize" the noise, making it appear more like the AWGN the model was trained on. $N_{es}$ is used to determine the optimal stride for a given image.
  2. Super-resolution Refinement: To counteract the over-smoothing common in deep denoisers, a 5-layer CNN is appended to the pipeline. This stage focuses on restoring textural details and enhancing visual sharpness, even if it slightly reduces formal PSNR metrics.

Experimental Results

The framework was evaluated on both synthetic and real-world benchmarks, showing significant improvements over existing methods.

  • Synthetic Mixed Noise: On the PGB dataset (AWGN + RVIN), the model outperformed DnCNN-B by 2.4 dB in PSNR.
  • Real-World Performance: On the Darmstadt Noise Dataset (DND), the model achieved a PSNR of 37.12 dB, significantly surpassing DnCNN (32.43 dB) and traditional methods like BM3D (34.51 dB).
Figure 6: The final denoised output, demonstrating the effectiveness of the adaptive framework in restoring clarity and sharpness.

Conclusion

By disentangling noise estimation from the denoising process and employing spatial adaptation strategies like pixel-shuffling, this research provides a robust path for applying theoretically-grounded models to the messy reality of digital imaging. The results on the DND benchmark confirm that explicit noise modeling is superior to "black-box" blind denoising for real-world applications.

Summary updated

Abstract

Discriminative learning based denoising model trained with Additive White Gaussian Noise (AWGN) performs well on synthesized noise. However, realistic noise can be spatialvariant, signal-dependent and a mixture of complicated noises. In this paper, we explore multiple strategies for applying an AWGN-based denoiser to realistic noise. Specifically, we trained a deep network integrating noise estimating and denoiser with mixed Gaussian (AWGN) and Random Value Impulse Noise (RVIN). To adapt the model to realistic noises, we investigated multi-channel, multi-scale and super-resolution approaches. Our preliminary results demonstrated the effectiveness of the newly-proposed noise model and adaptation strategies.
BibTeX
@inproceedings{zhou2019adaptation,
  author = {Yuqian Zhou and Jianbo Jiao and Haibin Huang and Jue Wang and Thomas S. Huang},
  title = {{Adaptation Strategies for Applying AWGN-Based Denoiser to Realistic Noise}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2019},
  doi = {10.1609/aaai.v33i01.330110085},
}
Figure