Improving Spectral-Based Endmember Finding by Exploring Spatial Context for Hyperspectral Unmixing

Shaohui Mei, Ge Zhang, Jun Li, Yifan Zhang, Qian DuIEEE JSTARS 2020 · OpenReview

Introduction

Hyperspectral unmixing is a critical task in remote sensing, aimed at decomposing mixed pixels into pure constituent materials, known as endmembers, and their corresponding fractional abundances. While traditional endmember finding (EF) algorithms have relied primarily on spectral information, they often struggle with spectral variation caused by noise, lighting, or topography. Recent research highlights that spatial context—the relationship between a pixel and its neighbors—is a vital piece of missing information. This paper proposes three novel Spatial Exploiting (SE) strategies to enhance spectral-based EF (sEF) algorithms by integrating this spatial distribution data.

Proposed Spatial Exploiting Strategies

The core idea is to "clean" or revise spectral signatures by leveraging local neighborhoods. The authors introduce three specific methods:

  1. Local Linear Representation (LLR): Reconstructs a pixel as a linear combination of its neighbors, effectively averaging out local noise while preserving the underlying spectral shape.
  2. Local Sparse Representation (LSR): Employs a sparsity constraint (L1-norm) to ensure the pixel is reconstructed using only the most relevant neighbors, which is crucial in heterogeneous areas.
  3. SVD-Based Strategy: Operates in the feature domain by performing Singular Value Decomposition on a local neighborhood and using dominant singular vectors to filter out noise.
The proposed ssEE algorithm pipeline using SE as a preprocessing stage to revise the hyperspectral image before endmember extraction.

A key innovation is the "Anomaly Switch." To prevent the "oversmoothing" common in spatial methods—which can erase rare, small-scale targets—the algorithm compares the revised pixel to the original using Spectral Angle Distance. If the difference is too large, the pixel is flagged as an anomaly, and the original signature is preserved. These strategies are versatile, functioning as either a preprocessing step for the entire image or a postprocessing step to refine identified endmembers.

Conceptual Impact on the Data Simplex

In the spectral feature space, hyperspectral data typically forms a simplex where the vertices represent pure endmembers. Noise and spectral variation cause pixels to deviate from this ideal structure, making it difficult for sEF algorithms to identify the true vertices.

Illustration of SE Pre-processing: Original pixels (blue) are revised (red) to form a tighter, more accurate simplex, allowing for better identification of endmembers (stars).

As shown in the figure above, SE preprocessing moves the observed pixels (blue) toward a more representative "revised" state (red). This tightening of the data cloud allows the EF algorithm to find endmembers (red stars) that are much closer to the true physical signatures than those found using raw data (blue stars).

Experimental Results

The proposed methods were tested on synthetic fractal datasets, the Cuprite mineral dataset, and the Urban HYDICE dataset.

  • Accuracy and Robustness: In synthetic tests, SE-LLR and SE-LSR consistently outperformed state-of-the-art methods like SPP and SSPP, particularly in high-noise environments (10dB to 30dB SNR), achieving significantly lower Spectral Angle Distance (SAD) scores.
  • Anomaly Preservation: Unlike competing spatial methods that often smooth away rare materials, the proposed strategies maintained a near 100% success rate in detecting hidden "abnormal" pixels, thanks to the anomaly switch.
  • Real-World Efficacy: On the Cuprite dataset, the SE-SVD method demonstrated the lowest reconstruction error, proving its effectiveness in complex mineralogical mapping.

Conclusion

By integrating spatial context, the proposed SE strategies significantly improve the performance of traditional spectral-based unmixing. While postprocessing offers a computationally efficient alternative, preprocessing provides the highest accuracy. Future work will focus on automating parameter selection, such as window sizes and anomaly thresholds, to make these powerful tools more accessible for automated remote sensing pipelines.

Summary updated

Abstract

Hyperspectral unmixing, which intends to decompose mixed pixels into a collection of endmembers weighted by their corresponding fraction abundances, has been widely utilized for remote sensing image exploitation. Recent studies have revealed that spatial context of pixels is important complemental information for hyperspectral image processing. However, many well-known endmember finding (EF) algorithms identify spectrally pure spectra from hyperspectral images according to spectral information only, resulting in limited accuracy of hyperspectral unmixing application since they ignore spatial distribution or structure information in the image. Therefore, in this article, several novel spatial exploiting (SE) strategies are proposed to improve the performance of the well-known spectral-based EF (sEF) algorithms by integrating spatial information. Three different spatial exploiting strategies are designed to use pixel spatial context, by which the spectral variation of pixels can be alleviated to improve the performance of hyperspectral unmixing. Specifically, in pixel domain, the pixels are linearly reconstructed using their neighbors in which the spatially derived factor to weight the importance of the spectral information is generated using local linear representation and local sparse representation, while in the feature domain, pixels are revised using dominated features of neighboring pixels in singular value decomposition. The proposed spatial exploiting strategies can not only be used as a preprocessing stage to revise pixels for sEF algorithms, but also be used as a postprocessing step to revise endmembers found via sEF algorithms. Finally, experimental results on both synthetic and real hyperspectral datasets demonstrate that the proposed SE strategies can certainly improve the performance of several well-known sEF algorithms, and obtain more accurate unmixing results than several state-of-the-art spatial preprocessing methods.
BibTeX
@article{mei2020improving,
  author = {Shaohui Mei and Ge Zhang and Jun Li and Yifan Zhang and Qian Du},
  title = {{Improving Spectral-Based Endmember Finding by Exploring Spatial Context for Hyperspectral Unmixing}},
  journal = {IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens.},
  year = {2020},
  url = {https://openreview.net/forum?id=ruyY0QrlHr},
}
Figure