Démélange robuste d'images hyperspectrales en interprétant les pôles de mélange comme des données directionnelles

Lucas Drumetz, Jocelyn Chanussot, Akira IwasakiRevue 2018 · DOI

TL;DR

This paper proposes a novel hyperspectral unmixing algorithm that treats endmembers (pure material spectra) as directions rather than single points. This approach robustly handles material variability and illumination changes, leading to more accurate abundance estimations, especially in complex scenes with shadows and correlated materials.

What Problem Does This Paper Address?

Hyperspectral imaging allows for detailed material identification, but individual pixels often contain mixtures of materials. "Unmixing" aims to disentangle these mixtures by identifying the pure material spectra (endmembers) and their proportions (abundances) within each pixel. Traditional methods often struggle with real-world complexities like shadows, varying illumination, and intrinsic material variations, which can cause endmember extraction algorithms to fail. This paper tackles the challenge of endmember variability, proposing a new model that views endmembers not as fixed points but as directions in spectral space, allowing for more flexible and robust modeling.

Methods

The core of the proposed method is a new formulation of the Extended Linear Mixing Model (ELMM). Instead of assuming endmembers are single points, they are treated as directions in the ambient space. This is achieved by normalizing the reference endmember spectra to have unit norm, effectively placing them on a hypersphere. This formulation allows the algorithm to model variability more effectively.

The algorithm's optimization process involves:

  • Initialization: Using k-means with cosine similarity to find initial reference endmember directions. This is chosen because cosine similarity is invariant to spectral scaling, making it suitable for directional data.
  • Optimization: A block coordinate descent approach is used to iteratively update the abundance maps, local endmember spectra, scaling factors, and the reference endmember directions. The optimization for reference endmembers is performed on the "oblique manifold" to maintain the unit norm constraint.
  • Regularization: The cost function includes regularization terms to encourage local endmembers to stay close to scaled versions of the reference directions and to promote separation between reference directions.

Datasets

  • Synthetic Dataset: Generated using real spectral data from the University of Pavia dataset, incorporating intra-class variability and simulated illumination variations.
  • Real Dataset: An image acquired by the CASI-3 sensor over the Tama Forest Science Garden in Tokyo, known for its complex scene with correlated materials and significant shadow regions.

Key Insights and Ideas

  • Endmembers as Directions: The fundamental insight is that treating endmembers as directions, rather than fixed points, is a more accurate representation of material variability, especially under varying illumination.
  • Cosine Similarity for Initialization: Using k-means with cosine similarity is a robust way to initialize endmember directions, as it's insensitive to spectral scaling issues caused by illumination.
  • Oblique Manifold for Reference Endmembers: Constraining reference endmembers to lie on the unit hypersphere (oblique manifold) provides a geometrically sound way to represent directions and allows for meaningful distance comparisons between them.
  • Handling Shadows: The directional model, combined with scaling factors, proves effective at handling shadowed areas, which often lead to low-amplitude spectra that can be problematic for traditional methods.

Key Results

  • Quantitative Improvement: The proposed RMMLE algorithm significantly outperforms traditional methods like VCA+SCLSU and SCLSU in terms of abundance estimation error (aEQM) and spectral angle (SAM) on both synthetic and real datasets. For example, on the synthetic data, RMMLE achieved an aEQM of 0.0560 and SAM of 3.48 degrees, compared to SCLSU's 0.0654 and 6.32 degrees.
  • Qualitative Improvement: Visualizations (dispersion plots and abundance maps) show that RMMLE extracts more accurate and spatially coherent endmember directions and abundance maps, especially in challenging areas with shadows and correlated materials.
  • Robustness to Shadows and Variability: The algorithm demonstrates superior performance in scenes with shadows and materials exhibiting significant spectral variability, outperforming methods that rely on fixed endmember points.

Limitations and Future Work

  • Parameter Tuning: The performance of the algorithm relies on the choice of regularization parameters (As and Aso). While empirical tuning was performed, automatic parameter estimation is a desirable future direction.
  • Computational Cost: The proposed iterative optimization, while robust, is computationally more intensive than simpler methods like SCLSU.
  • Future Work: The authors suggest exploring automatic estimation of material-dependent variances for the Gaussian priors and investigating alternative ways to represent endmembers using directional data. They also plan to test the algorithm on different types of directional data.

Summary updated

Abstract

Le démélange d'images hyperspectrales vise à extraire les spectres des matériaux purs de la scène observée (pôles de mélange ou endmembers), ainsi que leurs proportions dans chaque pixel de l'image (abondances). La plupart des algorithmes s'appuient sur des techniques classiques d'extraction d'endmembers qui peuvent échouer dans des scénarios difficiles. Dans cet article, nous abordons ce problème en même temps que la variabilité des matériaux en considérant qu'un endmember est une direction dans l'espace ambiant plutôt qu'un seul point. Sous ce paradigme, nous proposons un algorithme pour fournir des spectres de référence robustes. Nous montrons le potentiel de l'algorithme proposé sur un jeu de données synthétiques en utilisant des spectres réels présentant de la variabilité intra-classe, et une image d'une scène naturelle complexe.
BibTeX
@inproceedings{drumetz2018demelange,
  author = {Lucas Drumetz and Jocelyn Chanussot and Akira Iwasaki},
  title = {{Démélange robuste d'images hyperspectrales en interprétant les pôles de mélange comme des données directionnelles}},
  booktitle = {Revue},
  year = {2018},
  doi = {10.52638/rfpt.2018.410},
}
Figure