Efficient blind deblurring under high noise levels

Jérémy Anger, Mauricio Delbracio, Gabriele Facciolo

TL;DR

This paper introduces a robust and computationally efficient framework for "blind" image deblurring—restoring a sharp image from a blurry one without knowing the cause of the blur—specifically designed to handle high levels of sensor noise. By adapting the $L_0$ gradient prior for kernel estimation and utilizing a "denoise-then-deconvolve" strategy, the authors achieve state-of-the-art restoration quality while being up to 10x faster than competing methods.

What Problem Does This Paper Address?

Blind deblurring is a classic "chicken and egg" problem in computer vision: to deblur an image, you need to know the blur kernel (the path the camera took while the shutter was open), but to estimate that kernel accurately, you usually need a sharp version of the image.

While many algorithms work well on clean images, they often fail in the real world. Why? Because motion blur typically happens in low-light conditions where exposure times are long. Low light also means high sensor noise. Most existing algorithms mistake noise for image edges or kernel features, leading to "ringing" artifacts or completely incorrect kernel estimates. The challenge is to separate the structural information needed for deblurring from the random noise that obscures it.

Methods

The authors propose a two-stage approach: Kernel Estimation followed by Non-blind Deconvolution.

1. Robust Kernel Estimation

The method iterates between predicting a sharp image and estimating the blur kernel.

  • Sharp Image Prediction: They use an $L_0$ gradient prior, which essentially encourages the image to have many flat regions and a few sharp edges. The "aha" moment here is that by simply increasing the regularization threshold ($\lambda_{min}$), the $L_0$ prior acts as a hard threshold that ignores noise spikes while preserving the main structures needed to estimate the blur.
  • Kernel Priors: Unlike many methods that use ad-hoc filtering on the kernel, this paper incorporates $L_1$ (sparsity) and $L_2$ (smoothness) priors directly into the kernel optimization. This ensures the estimated kernel is physically plausible and less affected by noise.
  • Efficiency: They use a coarse-to-fine multiscale scheme but optimize it by "warm-starting" iterations, reducing the number of required inner loops from five down to two per scale.

2. Denoise-then-Deconvolve

Once the kernel is known, the final image must be reconstructed. Instead of complex, iterative schemes that try to denoise and deconvolve simultaneously, the authors show that a simple sequential approach works best:

  1. Denoise the blurry image using a modern CNN-based denoiser (FFDNet).
  2. Deconvolve the denoised image using a standard Total Variation (TV) regularized algorithm. This prevents the deconvolution from amplifying residual noise into "ringing" artifacts.

Datasets

  • Levin et al. [36]: A standard synthetic benchmark for deblurring. The authors extended this by adding three levels of Gaussian noise (0%, 5%, and 10%) to test robustness.
  • Sun et al. [37]: Used for quantitative PSNR (Peak Signal-to-Noise Ratio) comparisons.
  • Real-world images: Specifically, images from Zhong et al. [9] were used to demonstrate performance on actual camera-shake scenarios.

Key Insights and Ideas

  • $L_0$ is secretly a noise filter: The $L_0$ gradient prior is often seen as a way to find edges, but the authors demonstrate it is remarkably robust to noise if the regularization parameter is tuned correctly. It effectively "ignores" anything below a certain intensity threshold.
  • Kernel constraints matter: By enforcing non-negativity and spatial constraints (the kernel must exist within a small rectangular domain) alongside $L_1/L_2$ priors, the kernel estimation becomes much more stable in high-noise environments.
  • Simplicity wins in deconvolution: While many researchers focus on complex "plug-and-play" priors, the authors found that a high-quality CNN denoiser followed by a fast TV-deconvolution is both faster and more effective at preventing artifacts than more complex iterative methods.

Key Results

  • Accuracy: On the Levin dataset with 10% noise, the proposed method achieved a lower Root Mean Square Error (RMSE) for kernel estimation (0.151) compared to Pan et al. (0.171) and Zhong et al. (0.158).
  • Image Quality: In blind deblurring tests with 10% noise, the proposed method reached a PSNR of 25.10 dB, significantly outperforming Tao et al. (20.28 dB) and Zhong et al. (23.38 dB).
  • Speed: The algorithm is highly efficient. For a $512 \times 512$ image, it runs in 17 seconds, compared to 72s for Zhou et al. and 165s for Pan et al. On a large real-world image ($964 \times 1201$), the entire process took only 26 seconds.

Limitations and Future Work

  • Non-uniform blur: The paper assumes a "stationary" blur model (the same blur across the whole image). In reality, camera rotation or moving objects cause non-uniform blur, which this specific implementation does not address.
  • JPEG Artifacts: The authors note that their current pipeline doesn't specifically handle JPEG compression artifacts, which often appear alongside noise in consumer photos.
  • Future Direction: They suggest integrating a neural network trained specifically on blurry, noisy images to further improve the non-blind deconvolution stage.

Summary updated

Abstract

The goal of blind image deblurring is to recover a sharp image from a motion blurred one without knowing the camera motion. Current state-of-the-art methods have a remarkably good performance on images with no noise or very low noise levels. However, the noiseless assumption is not realistic considering that low light conditions are the main reason for the presence of motion blur due to requiring longer exposure times. In fact, motion blur and moderate to high noise often appear together. Most works approach this problem by first estimating the blur kernel k and then deconvolving the noisy blurred image. In this work, we first show that current state-of-the-art kernel estimation methods based on the ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> gradient prior can be adapted to handle high noise levels while keeping their efficiency. Then, we show that a fast non-blind deconvolution method can be significantly improved by first denoising the blurry image. The proposed approach yields results that are equivalent to those obtained with much more computationally demanding methods.
BibTeX
@inproceedings{anger2019efficient,
  author = {Jérémy Anger and Mauricio Delbracio and Gabriele Facciolo},
  title = {{Efficient blind deblurring under high noise levels}},
  booktitle = {ISPA},
  year = {2019},
  url = {https://openreview.net/forum?id=OUPCKemQLT6},
}

Loading related content...

Figure