Denoising Method for Passive Photon Counting Images Based on Block-Matching 3D Filter and Non-Subsampled Contourlet Transform

Xuan Wang, Liju Yin, Mingliang Gao, Zhenzhou Wang, Jin Shen, Guofeng ZouSensors 2019 · DOI

TL;DR

This paper introduces a novel method for denoising and enhancing images captured in extremely low-light conditions using multi-pixel photon counting detectors. By combining the Non-Subsampled Contourlet Transform (NSCT) for feature decomposition with an improved Block-Matching 3D (BM3D) filter for noise reduction, the approach significantly improves image quality and detail preservation compared to existing methods.

What Problem Does This Paper Address?

Images captured in low-light environments (e.g., moonlight, starlight) often suffer from severe limitations: low contrast, low brightness, and significant noise. These issues make it difficult to extract meaningful information or achieve good visual quality. Traditional image enhancement techniques can sometimes exacerbate these problems, leading to over-equalization or loss of detail. Photon counting detectors, while useful in these scenarios, also introduce specific noise characteristics that require specialized denoising approaches. This paper aims to tackle these challenges by developing a robust method for denoising and enhancing these challenging low-light images.

Methods

The proposed method integrates several key techniques:

  • Non-Subsampled Contourlet Transform (NSCT): This transform is applied to both the original low-light image and its histogram-equalized version. NSCT is chosen for its ability to capture directional features and its translation invariance, which is superior to standard wavelet transforms for image analysis. The NSCT decomposes the image into low- and high-frequency sub-bands.
  • Fusion Rules: Different fusion rules are employed for the low- and high-frequency sub-bands.
  • Low-frequency sub-bands: These contain the bulk of image energy and background information. A fusion rule based on regional energy is used to enhance brightness and improve image quality without excessive computational complexity.
  • High-frequency sub-bands: These contain finer details and noise. A novel symbol function and a Bayes-shrink threshold are applied to preserve important line features while suppressing noise.
  • Adaptive Single-Scale Retinex (SSR): This technique is applied to the enhanced low-frequency components to further improve brightness and contrast.
  • Improved Block-Matching 3D (BM3D) Filter: After the NSCT inverse transform, the denoised image is further processed by an optimized BM3D filter. The improvement lies in a simplified grouping process by block-matching, which speeds up computation without sacrificing denoising performance.

Datasets

The authors used images captured from their custom experimental platform, which includes a multi-pixel photon counting detector. The test images had resolutions of 120x120 and 100x100 pixels. They also used a standard "Lena" image for testing. No new benchmark datasets were introduced.

Key Insights and Ideas

  • Synergistic Fusion: Combining NSCT with histogram equalization before applying fusion rules is crucial. This approach leverages the strengths of both techniques to handle the extreme illumination and contrast issues.
  • Targeted Sub-band Processing: Treating low- and high-frequency sub-bands differently based on their content (energy vs. detail/noise) is key to achieving both enhancement and denoising.
  • Adaptive Enhancement: The use of adaptive SSR and adaptive scale parameters in the retinex algorithm allows for better adaptation to local image characteristics.
  • Optimized BM3D: Streamlining the BM3D grouping process significantly reduces computational load, making the method more practical.

Key Results

The proposed method demonstrated superior performance compared to several classical denoising and enhancement algorithms (Wavelet Threshold, WA-FICA, NSCT, and BM3D) in terms of both subjective visual quality and objective evaluation indices.

  • Visual Improvement: The denoised images exhibited significantly better contrast, brightness, and detail preservation, especially in challenging areas like edges and fine textures.
  • Objective Metrics: Tables 2 and 3 show that the proposed method achieved the highest Information Entropy (IE) values, indicating more preserved information. It also achieved the lowest NIQE and BRISQUE scores, which correspond to better image quality according to these blind image quality assessment metrics. For example, in Figure 7, the proposed method clearly delineated the handle of a cup, which was blurred in other methods.

Limitations and Future Work

  • Universal Applicability: The authors acknowledge that the method does not have universal applicability for all low-light environments, particularly at extremely low illumination levels (10⁻⁵−10⁻⁶ lux).
  • Noise Mechanism: They suggest that at very low illuminations, the noise mechanism might change, and the current algorithm's presuppositions may not hold.
  • Future Research: The authors plan to investigate specific noise types and distributions under different illumination levels to expand the algorithm's applicability. They also aim to research noise distributions in different illuminations and propose algorithms with wider applicability.

Summary updated

Abstract

Multi-pixel photon counting detectors can produce images in low-light environments based on passive photon counting technology. However, the resulting images suffer from problems such as low contrast, low brightness, and some unknown noise distribution. To achieve a better visual effect, this paper describes a denoising and enhancement method based on a block-matching 3D filter and a non-subsampled contourlet transform (NSCT). First, the NSCT was applied to the original image and histogram-equalized image to obtain the sub-band low- and high-frequency coefficients. Regional energy and scale correlation rules were used to determine the respective coefficients. Adaptive single-scale retinex enhancement was applied to the low-frequency components to improve the image quality. The high-frequency sub-bands whose line features were best preserved were selected and processed using a symbol function and the Bayes-shrink threshold. After applying the inverse transform, the fused photon counting image was subjected to an improved block-matching 3D filter, significantly reducing the operation time. The final result from the proposed method was superior to those of comparative methods in terms of several objective evaluation indices and exhibited good visual effects and details from the objective impression.
BibTeX
@inproceedings{wang2019denoising,
  author = {Xuan Wang and Liju Yin and Mingliang Gao and Zhenzhou Wang and Jin Shen and Guofeng Zou},
  title = {{Denoising Method for Passive Photon Counting Images Based on Block-Matching 3D Filter and Non-Subsampled Contourlet Transform}},
  booktitle = {Sensors},
  year = {2019},
  doi = {10.3390/s19112462},
}
Figure