Hierarchical Sparse Learning with Spectral-Spatial Information for Hyperspectral Imagery Denoising

Shuai Liu, Licheng Jiao, Shuyuan Yang

TL;DR

This paper introduces a novel hierarchical sparse learning framework for hyperspectral image (HSI) denoising. By adaptively segmenting spectral bands and employing a Bayesian approach with a hierarchical dictionary, the method effectively suppresses various noises while preserving crucial spectral-spatial information, outperforming existing state-of-the-art techniques.

What Problem Does This Paper Address?

Hyperspectral imagery (HSI) offers rich spectral and spatial information, making it invaluable for applications like remote sensing and medical diagnostics. However, HSI acquisition is prone to various noises (Gaussian, Poisson, dead pixels, stripes) that significantly degrade image quality and hinder subsequent analysis. Existing denoising methods often struggle to simultaneously address these diverse noise types and preserve the intricate spectral-spatial correlations inherent in HSI, leading to loss of detail or incomplete noise removal. This paper aims to tackle this challenge by developing a more robust and comprehensive HSI denoising approach.

Methods

The proposed method employs a hierarchical sparse learning framework within a Bayesian setting. Key components include:

  • Spectral-Spatial Data Extraction: HSI bands are adaptively segmented into "band-subsets" based on structural correlation (measured by SSIM) between adjacent bands. This segmentation helps to group spectrally similar bands. Within each band-subset, overlapping cubic patches are extracted to capture local spatial and spectral information.
  • Hierarchical Dictionary Model: Each patch is modeled as a clean component (linear combination of dictionary atoms), a Gaussian noise component, and a sparse noise component.
  • The clean component utilizes a dictionary whose atoms are regularized by a Gaussian process with Gamma distribution to enforce spatial consistency.
  • The noise components are modeled to capture both Gaussian and sparse noise characteristics.
  • Adaptive Sparseness: The Beta-Bernoulli process is used to adaptively determine the sparseness of the model, allowing for efficient representation.
  • Bayesian Inference: A Gibbs sampler is employed to estimate the model parameters, including the dictionary and noise characteristics, without requiring prior knowledge of the HSI.

Datasets

The paper evaluates the proposed method on two well-known hyperspectral datasets:

  • Pavia University Data: A simulated dataset used for evaluating performance under various noise conditions (Gaussian, Poisson, dead pixel lines).
  • Urban Data and Indian Pines Data: Real-world datasets used for evaluating denoising performance on naturally occurring noise and artifacts.

Key Insights and Ideas

  • Adaptive Band Segmentation is Crucial: Simply treating all spectral bands uniformly or partitioning them arbitrarily can discard valuable spectral correlations. The proposed adaptive segmentation based on SSIM effectively groups spectrally similar bands, leading to better denoising.
  • Hierarchical Structure Captures Complexity: The hierarchical dictionary and the explicit modeling of both Gaussian and sparse noise components allow the framework to better represent and remove diverse noise types present in HSI.
  • Bayesian Inference for Robustness: Using a Bayesian approach with Gibbs sampling allows for learning model parameters (including dictionary and noise characteristics) directly from the data, making the method more robust and less reliant on manual tuning.
  • Sparse Noise Modeling is Essential: The inclusion of a specific sparse noise term significantly improves the ability to remove artifacts like dead pixel lines and stripes, which are often missed by methods focusing solely on Gaussian noise.

Key Results

  • Superior Noise Suppression: The proposed method consistently outperforms six state-of-the-art denoising algorithms (KSVD, BM3D, ANLM3D, BM4D, LRMR, DDL3+FT) in terms of both quantitative metrics (PSNR, FSIM) and visual quality across various noise scenarios (Gaussian, Poisson, dead pixel lines, stripes, and mixtures).
  • Preservation of Spectral-Spatial Information: The method effectively preserves fine details, edges, and textures, which are critical for subsequent HSI analysis tasks like classification.
  • Improved Classification Accuracy: When applied to denoised data, the proposed method leads to significantly higher classification accuracies (OA and kappa coefficients) on the Indian Pines dataset compared to other denoising methods, demonstrating its effectiveness in restoring information vital for analysis.
  • Robustness to Noise Types: The framework demonstrates strong performance in suppressing a wide range of noises, including complex mixtures, which is a significant advantage over methods designed for specific noise types.

Limitations and Future Work

  • Computational Complexity: The paper acknowledges that the proposed framework consumes significantly more time than the six compared algorithms. This is attributed to the complexity of the hierarchical model and Gibbs sampling.
  • Future Work: The authors suggest future research directions focused on exploiting "appropriately hidden structure" and reducing the computational time for HSI analysis. This implies exploring more efficient inference methods or model optimizations.

Summary updated

Abstract

During the acquisition process hyperspectral images (HSI) are inevitably corrupted by various noises, which greatly influence their visual impression and subsequent applications. In this paper, a novel Bayesian approach integrating hierarchical sparse learning and spectral-spatial information is proposed for HSI denoising. Based on the structure correlations, spectral bands with similar and continuous features are segmented into the same band-subset. To exploit local similarity, each subset is then divided into overlapping cubic patches. All patches can be regarded as consisting of clean image component, Gaussian noise component and sparse noise component. The first term is depicted by a linear combination of dictionary elements, where Gaussian process with Gamma distribution is applied to impose spatial consistency on dictionary. The last two terms are utilized to fully depict the noise characteristics. Furthermore, the sparseness of the model is adaptively manifested through Beta-Bernoulli process. Calculated by Gibbs sampler, the proposed model can directly predict the noise and dictionary without priori information of the degraded HSI. The experimental results on both synthetic and real HSI demonstrate that the proposed approach can better suppress the existing various noises and preserve the structure/spectral-spatial information than the compared state-of-art approaches.
BibTeX
@inproceedings{liu2016hierarchical,
  author = {Shuai Liu and Licheng Jiao and Shuyuan Yang},
  title = {{Hierarchical Sparse Learning with Spectral-Spatial Information for Hyperspectral Imagery Denoising}},
  booktitle = {Sensors},
  year = {2016},
  url = {https://openreview.net/forum?id=uydQcg2ino0},
}
Figure