Improved Hyperspectral Unmixing with Endmember Variability Parametrized Using an Interpolated Scaling Tensor

Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez

TL;DR

This paper proposes a two-step approach to hyperspectral unmixing that accounts for "endmember variability"—the fact that materials like grass or asphalt look different depending on lighting and conditions. By leveraging pure pixel information and assuming that spectral changes are smooth and low-rank, the authors transform a mathematically "ill-posed" problem into a stable, highly accurate method for mapping material proportions.

What Problem Does This Paper Address?

Hyperspectral imaging (HI) captures hundreds of narrow spectral bands, allowing us to identify materials from a distance. Spectral Unmixing (SU) is the process of decomposing a pixel into its constituent "endmembers" (pure materials) and their "abundances" (the percentage of each material present).

The classic Linear Mixing Model (LMM) assumes that a material’s spectral signature is constant across the entire image. In reality, factors like topography, illumination, and atmospheric effects cause signatures to vary—a tree in the shade has a different spectral profile than a tree in the sun. While newer models like the Generalized Linear Mixing Model (GLMM) attempt to account for this, they often result in "ill-posed" optimization problems: there are simply too many unknown variables for the available data, leading to unstable or inaccurate results.

Methods

The authors propose a hybrid strategy that breaks the unmixing process into two sequential steps:

  1. Estimating the Scaling Tensor: Instead of guessing variability everywhere at once, the authors first identify "pure pixels" (pixels containing only one material). They use these as anchors to estimate a 4D interpolated scaling tensor ($\Psi$). This tensor represents how each band of each material scales across the image. To keep the math stable, they apply two key constraints:
  2. Smoothness: They assume variability changes gradually across the scene, modeled by a low-rank tensor structure.
  3. Proximity to Unity: They assume variability is generally small, so the scaling factors should stay close to 1.
  4. The Unmixing Step: With the variability factors now "pre-calculated," the actual unmixing becomes much easier. The authors solve a matrix-factorization problem to find the fractional abundances. They include a spatial regularization term (Total Variation) to ensure that the resulting material maps look realistic and cohesive.

This approach effectively uses the "easy" parts of the image (pure pixels) to solve the "hard" parts (mixed pixels).

Datasets

The researchers evaluated their method using:

  • Synthetic HI: A simulated dataset created using the USGS Spectral Library. They added artificial variability using a 3D Gaussian filter and introduced noise to test the algorithm's robustness.
  • Houston Dataset: A well-known real-world benchmark captured over the University of Houston campus. It features four primary endmembers: Vegetation, Concrete, Asphalt, and Metal Roofs.

Key Insights and Ideas

  • Pure Pixels as Ground Truth: While many modern algorithms try to be "blind" (ignoring pure pixel locations), this paper argues that ignoring them is a waste of valuable information. Using them to "anchor" the variability estimation significantly reduces the search space for the optimization.
  • The Power of Low-Rank Tensors: Spectral variability isn't random noise; it's usually driven by physical processes like shadows or moisture. Modeling this as a low-rank tensor captures the underlying physical structure of the scene without overfitting to noise.
  • Decoupling the Problem: By solving for variability before solving for abundances, the authors turn a single, massive, unstable problem into two smaller, well-behaved ones.

Key Results

The proposed method outperformed standard algorithms (FCLS, PLMM, ELMM, and GLMM) in several metrics:

  • Abundance Accuracy: On synthetic data, the Root Mean Squared Error for abundances ($RMSE_A$) was 0.0233, significantly lower than the standard GLMM's 0.0343.
  • Visual Fidelity: On the Houston dataset, the abundance maps were noticeably cleaner. The method was particularly good at distinguishing between concrete and vegetation in complex areas like stadium stands.
  • Computational Trade-off: The improved accuracy comes at a cost; the method is roughly 2.77 times slower than the standard GLMM. However, the authors argue this is a "modest increase" given the substantial gains in estimation accuracy.

Limitations and Future Work

The primary limitation is the reliance on pure pixels. If a hyperspectral image is extremely "coarse" (where every single pixel is a complex mixture of many materials), the first step of the algorithm may lack the necessary anchor points to interpolate the scaling tensor accurately.

Future work could involve adapting the tensor interpolation strategy for scenes where pure pixels are scarce or exploring more automated ways to tune the various regularization parameters ($\lambda_M, \lambda_A, \lambda_\Psi$) that currently require manual selection.

Summary updated

Abstract

Endmember (EM) variability has an important impact on the performance of hyperspectral image (HI) analysis algorithms. Recently, extended linear mixing models have been proposed to account for EM variability in the spectral unmixing (SU) problem. The direct use of these models has led to severely ill-posed optimization problems. Different regularization strategies have been considered to deal with this issue, but none so far has consistently exploited the information provided by the existence of multiple pure pixels often present in HIs. In this work, we propose to break the SU problem into a sequence of two problems. First, we use pure pixel information to estimate an interpolated tensor of scaling factors representing spectral variability. This is done by considering the spectral variability to be a smooth function over the HI and confining the energy of the scaling tensor to a low-rank structure. Afterwards, we solve a matrix-factorization problem to estimate the fractional abundances using the variability scaling factors estimated in the previous step, what leads to a significantly more well-posed problem. Simulations with synthetic and real data attest the effectiveness of the proposed strategy.
BibTeX
@inproceedings{borsoi2019improved,
  author = {Ricardo Augusto Borsoi and Tales Imbiriba and José Carlos Moreira Bermudez},
  title = {{Improved Hyperspectral Unmixing with Endmember Variability Parametrized Using an Interpolated Scaling Tensor}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2019},
  url = {https://openreview.net/forum?id=PnbS6AT95Q},
}

Loading related content...

Figure