An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing

Danfeng Hong, Naoto Yokoya, Jocelyn Chanussot, Xiao Xiang Zhu

TL;DR

The Augmented Linear Mixing Model (ALMM) provides a robust framework for hyperspectral unmixing by simultaneously modeling illumination-driven scaling factors and complex environmental spectral variations. By embedding a data-driven dictionary learning process into the unmixing pipeline, ALMM significantly outperforms traditional linear models in estimating accurate material abundance maps.

What Problem Does This Paper Address?

Hyperspectral sensors capture data across hundreds of narrow spectral bands, but their relatively low spatial resolution often results in "mixed pixels"—single pixels containing multiple materials (e.g., soil, grass, and water). Hyperspectral unmixing is the process of decomposing these pixels into their constituent materials (endmembers) and their proportions (abundances).

The standard approach, the Linear Mixing Model (LMM), assumes that a material's spectral signature is constant across an entire image. In reality, signatures vary due to illumination changes, topography, atmospheric conditions, and sensor noise—a phenomenon called spectral variability. While previous models like the Extended LMM (ELMM) handle scaling (illumination) and the Perturbed LMM (PLMM) handle additive noise, neither captures the full complexity of real-world variability, leading to "noisy" or inaccurate abundance maps.

Methods

The authors propose the Augmented Linear Mixing Model (ALMM), which decomposes the observed signal into three primary components:

  1. Scaling Component ($AXS$): Inherited from the ELMM, this part uses the known endmember dictionary ($A$) and applies pixel-wise scaling factors ($S$) to account for topography and lighting.
  2. Augmented Variability Component ($EB$): This is the core novelty. It introduces a "spectral variability dictionary" ($E$) and a coefficient matrix ($B$) to capture complex residuals like atmospheric effects and nonlinear mixing that scaling alone cannot explain.
  3. Residual Noise ($R$): Standard additive noise.

To solve this, the authors use a data-driven dictionary learning strategy. They introduce a "low-coherence" prior, ensuring that the atoms in the variability dictionary ($E$) are distinct from the actual material signatures in $A$. This prevents the model from accidentally confusing a real material with a variation of another. The entire system is optimized using the Alternating Direction Method of Multipliers (ADMM), an efficient algorithm for handling complex, constrained optimization problems.

Datasets

The model was evaluated on three distinct datasets:

  • Synthetic Dataset: Created using five reference endmembers from the USGS library, simulated with random scaling factors and 25dB Gaussian noise to provide a controlled ground truth.
  • Urban Dataset: Real-world data from the HYDICE sensor over Copperas Cove, Texas. It features four main materials: asphalt, grass, trees, and roof.
  • Cuprite Dataset: A classic benchmark from the AVIRIS sensor over a mining district in Nevada, used to test the model's ability to distinguish between highly similar mineral signatures (e.g., Alunite, Chalcedony).

Key Insights and Ideas

  • Variability is not Gaussian: The authors demonstrate that spectral variability in real scenes follows a complex distribution (closer to a Gaussian Mixture Model) rather than a simple bell curve, justifying the need for a learned dictionary over simple statistical assumptions.
  • Separation of Concerns: By modeling scaling (physics-based) and other variabilities (data-driven) separately, the model maintains physical interpretability while remaining flexible enough to handle "sticky" environmental noise.
  • The Power of Low-Coherence: Forcing the variability dictionary to be "low-coherent" with endmembers is the "secret sauce." It ensures that the model doesn't use the variability term to "cheat" by absorbing signal that actually belongs to a different material.

Key Results

ALMM consistently outperformed state-of-the-art methods (like SUnSAL, PLMM, and ELMM) across all metrics:

  • Synthetic Data: Achieved an abundance Root Mean Square Error (aRMSE) of 2.15, compared to 3.23 for ELMM and 6.21 for PLMM.
  • Urban Data: In a classification-based evaluation, ALMM reached an Overall Accuracy (OA) of 78.70%, a significant jump from ELMM’s 62.41%.
  • Qualitative Improvement: Visual inspections of the abundance maps show that ALMM produces much "purer" results with higher contrast, successfully identifying materials in areas where other models saw only noise or mixed signals.

Limitations and Future Work

  • Non-Convexity: The optimization problem is non-convex, meaning the algorithm's success depends on a good starting point. The authors currently use the Scaled Constrained Least Squares Unmixing (SCLSU) result for initialization to mitigate this.
  • Computational Complexity: The dictionary learning step adds overhead. While ADMM is efficient, the computational cost is dominated by matrix products ($O(DL^2N)$), which might be intensive for extremely large-scale satellite imagery.
  • Future Directions: The authors suggest exploring more advanced spatial priors (like Total Variation) to further smooth the abundance maps and potentially automating the selection of the variability dictionary size ($L$).

Summary updated

Abstract

Hyperspectral imagery collected from airborne or satellite sources inevitably suffers from spectral variability, making it difficult for spectral unmixing to accurately estimate abundance maps. The classical unmixing model, the linear mixing model (LMM), generally fails to handle this sticky issue effectively. To this end, we propose a novel spectral mixture model, called the augmented LMM, to address spectral variability by applying a data-driven learning strategy in inverse problems of hyperspectral unmixing. The proposed approach models the main spectral variability (i.e., scaling factors) generated by variations in illumination or typography separately by means of the endmember dictionary. It then models other spectral variabilities caused by environmental conditions (e.g., local temperature and humidity and atmospheric effects) and instrumental configurations (e.g., sensor noise), and material nonlinear mixing effects, by introducing a spectral variability dictionary. To effectively run the data-driven learning strategy, we also propose a reasonable prior knowledge for the spectral variability dictionary, whose atoms are assumed to be low-coherent with spectral signatures of endmembers, which leads to a well-known low-coherence dictionary learning problem. Thus, a dictionary learning technique is embedded in the framework of spectral unmixing so that the algorithm can learn the spectral variability dictionary and estimate the abundance maps simultaneously. Extensive experiments on synthetic and real datasets are performed to demonstrate the superiority and effectiveness of the proposed method in comparison with the previous state-of-the-art methods.
BibTeX
@article{hong2019augmented,
  author = {Danfeng Hong and Naoto Yokoya and Jocelyn Chanussot and Xiao Xiang Zhu},
  title = {{An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing}},
  journal = {IEEE Trans. Image Process.},
  year = {2019},
  url = {https://openreview.net/forum?id=ogW4PowAa6},
}

Loading related content...

Figure