Imaging static Fourier transform spectrometry: impact of trajectory perturbations on the hyperspectral images

Varvara Chiliaeva, Olivier Gazzano, Yann Ferrec, Hervé Sauer, Andrés Almansa, François Goudail2023 · DOI

TL;DR

This paper investigates how small errors in the trajectory of an imaging static Fourier transform spectrometer (isFTS) can introduce significant artifacts and degrade the quality of hyperspectral images. The authors developed a simulation tool to model these effects and found that these trajectory perturbations disproportionately impact regions with high radiance gradients, leading to spectral distortions and parasitic peaks.

What Problem Does This Paper Address?

Imaging static Fourier transform spectrometry (isFTS) is a powerful technique for acquiring hyperspectral data from airborne or spaceborne platforms. Unlike traditional spectrometers, isFTS captures spectral information by taking a series of instantaneous images, which are then computationally reconstructed into a full spectrum for each pixel. A critical step in this process is the precise registration (alignment) of these instantaneous images. However, even minor deviations in the platform's trajectory during image acquisition can lead to misalignments. These registration errors can introduce artifacts into the final hyperspectral data, making it difficult to accurately interpret the scene. This paper aims to quantify the impact of these trajectory perturbations on isFTS image quality and spectral fidelity, identifying the specific conditions under which these errors are most detrimental.

Methods

The authors developed a comprehensive simulation program that models the entire isFTS processing chain, from image acquisition to spectral reconstruction. This program can accurately reproduce the degradations observed in real isFTS images. They used this tool to study the effects of two types of trajectory perturbations:

  • Single Registration Error: This simulates a one-time, localized misalignment. They derived a theoretical model to predict the spectral and spatial artifacts caused by such errors, focusing on how they affect regions of high radiance gradient.
  • Multiple Registration Errors: This extends the analysis to more realistic scenarios, specifically investigating:
  • White Noise: This models random, uncorrelated trajectory errors, simulating scenarios like platform micro-vibrations.
  • Sinusoidal Perturbations: This models periodic trajectory variations, which can arise from specific types of platform motion or vibrations.

The simulation program allows for precise control over scene characteristics, trajectory perturbations, and instrument parameters, enabling a detailed analysis of the resulting spectral and spatial distortions.

Datasets

Not discussed in the paper. The authors used simulated data generated by their custom simulation program.

Key Insights and Ideas

  • Sensitivity to Radiance Gradients: Trajectory perturbations have a much more pronounced effect in regions of high radiance gradient (e.g., edges of objects) compared to uniform areas. This is because small misalignments in these areas lead to a significant mixing of spectral information from adjacent pixels.
  • Spatial Correlation of Noise: Even when trajectory perturbations are temporally uncorrelated (like white noise), the resulting artifacts in the hyperspectral images can be spatially correlated, appearing as patterns or streaks.
  • Spectral Artifacts: Perturbations can introduce parasitic peaks into the reconstructed spectra, which can be mistaken for actual spectral features of the scene. The location and amplitude of these parasitic peaks depend on the nature of the perturbation (e.g., its periodicity).
  • Approximation Limitations: While a theoretical model based on intensity gradients provides good agreement with simulations, it neglects the effect of interference fringes in the raw images. This approximation leads to discrepancies, particularly in scenarios with monochromatic emissions, where the fringe contrast is significant.

Key Results

  • The simulation tool successfully reproduced observed artifacts in real isFTS data, validating its accuracy.
  • The theoretical analysis of single registration errors showed that perturbations lead to a sinusoidal behavior in the spectral domain, with a frequency related to the wavenumber and the perturbation's spatial extent.
  • Simulations of white noise perturbations demonstrated that standard deviation of intensity estimation errors is highest in high-gradient regions.
  • Sinusoidal perturbations were shown to introduce parasitic peaks in the spectrum at specific frequencies related to the perturbation's periodicity, which were not fully captured by the simplified theoretical model.

Limitations and Future Work

  • Approximated Theoretical Model: The authors acknowledge that their theoretical model, which neglects the fringes in the instantaneous images, has limitations, especially for monochromatic scenes. Future work could involve developing a more complete theoretical model that accounts for these fringes.
  • Complex Scenarios: The current study focused on relatively simple scenes (uniform rectangles, tilted wedges) and specific perturbation types. Future research could extend these simulations to more complex, realistic scenes with broad spectral signatures corresponding to actual materials.
  • Real-World Data Validation: While the simulation tool was validated against general observations from real instruments, further direct comparison with extensive real-world datasets under various perturbation conditions would be beneficial.

Summary updated

Abstract

Imaging static Fourier transform spectrometry (isFTS) may be used for pushbroom air- or spaceborne hyperspectral remote sensing. In isFTS, the spectral information is multiplexed over several instantaneous images, and numerical reconstruction is needed to recover the full spectrum for each pixel. The registration of instantaneous images is a crucial step. Unsufficient precision leads to artefacts on the images and degradation of the estimated spectra. We developed a simulation program of the entire processing chain of an isFTS system that can reproduce the degradations of actual isFTS images. Using this program we studied spatial and spectral effects of temporally correlated and uncorrelated trajectory perturbations. We also performed a theoretical study to quantify these degradations. We demonstrated that the most significant degradations occur in the regions of high radiance gradient.
BibTeX
@misc{chiliaeva2023imaging,
  author = {Varvara Chiliaeva and Olivier Gazzano and Yann Ferrec and Hervé Sauer and Andrés Almansa and François Goudail},
  title = {{Imaging static Fourier transform spectrometry: impact of trajectory perturbations on the hyperspectral images}},
  year = {2023},
  doi = {10.1117/12.2690836},
}
Figure