Designing a Compressive Sensing Demonstrator of an Earth Observation Payload in the Visible and Medium Infrared: Instrumental Concept and Main Features

Valentina Raimondi, Luigi Acampora, Massimo Baldi, Dirk Berndt, Tiziano Bianchi, Donato Borrelli, Chiara Corti, Francesco Corti, Marco Corti, N. L. J. Cox, Ulrike Dauderstädt, Peter Dürr, Alberto Fruchi, Sara Francés González, Donatella Guzzi, Detlef Kunze, Demetrio Labate, Nicolas Lamquin, Cinzia Lastri, Enrico Magli, Vanni Nardino, Christophe Pache, Lorenzo Palombi, G. Pilato, A. Pollini, Enrico Suetta, Dario Taddei, Davide Taricco, Diego Valsesia, Michael Wagner2021 · DOI

TL;DR

This paper introduces the SURPRISE demonstrator, a novel Earth Observation (EO) payload designed using compressive sensing (CS) principles. It aims to overcome limitations in spatial resolution and data bandwidth for infrared imaging by integrating a Spatial Light Modulator (SLM) for simultaneous sensing and compression, enabling enhanced onboard processing.

What Problem Does This Paper Address?

Traditional Earth Observation (EO) payloads, especially those operating in the medium infrared (MIR) spectrum, face significant challenges. Achieving higher spatial resolution and faster revisit times, crucial for advanced applications, often requires larger and more complex detector arrays. This leads to substantial data volumes that strain onboard processing capabilities and communication bandwidth. Furthermore, the availability of large focal plane detectors for MIR imaging is limited. The authors propose a solution that leverages Compressive Sensing (CS) to address these issues by enabling a more efficient approach to data acquisition and processing.

Methods

The core of the SURPRISE demonstrator's innovation lies in its adoption of a Compressive Sensing (CS) architecture. CS is a signal processing technique that allows for acquiring signals in a compact form and reconstructing them from fewer measurements than traditionally required, by exploiting the inherent sparsity of the signal.

The demonstrator employs a "single-pixel camera" inspired design. Key components include:

  • Collection Optics: To gather light from the target.
  • Spatial Light Modulator (SLM): This is the central component. It physically modulates the incoming light by applying different "coding masks." This process effectively performs a scalar product between the incoming image and the mask, creating a compressed measurement.
  • Condenser: For integrating the light.
  • Single-element Detector: To acquire the integrated, compressed signal.

Instead of acquiring a full image pixel by pixel, the SLM is programmed with a series of different masks. Each mask generates a single measurement. By acquiring a number of measurements (K) significantly smaller than the total number of pixels in the desired high-resolution image (N), the system achieves compression. The image is then reconstructed from these K measurements using specialized algorithms, often leveraging deep learning. The SURPRISE demonstrator is designed to achieve a super-resolution factor of at least 4x4, with a potential up to 32x32.

Datasets

Not discussed in the paper. The paper focuses on the demonstrator's design and principles, mentioning experiments on "natural target dataset and simulated hyperspectral images" for evaluation, but specific datasets are not detailed.

Key Insights and Ideas

  • CS as a Paradigm Shift: The paper highlights CS not just as a compression technique but as a fundamental shift in how imaging systems can be designed, merging sensing and compression into a single step.
  • SLM as the Core: The SLM is presented as the key enabler for implementing CS in an EO payload, allowing for dynamic modulation of the incoming light.
  • Onboard Processing Advantage: By acquiring compressed data, the demonstrator paves the way for significant onboard data processing and encryption, reducing the burden on downlink bandwidth and enabling faster analysis.
  • Deep Learning for Reconstruction: The authors emphasize the superior performance of deep learning methods for reconstructing images from CS measurements compared to traditional algorithms, especially for complex real-world scenarios.

Key Results

The paper presents the design and conceptual framework of the SURPRISE demonstrator. While specific quantitative results from the demonstrator itself are not detailed, the authors cite experiments showing that deep learning methods can provide improved accuracy in image reconstruction over traditional methods at various compression ratios. The demonstrator is designed to achieve a super-resolution factor of at least 4x4.

Limitations and Future Work

  • Demonstrator Status: The demonstrator is described as "under development" and "in progress," with its completion and full operational testing yet to be reported.
  • Reconstruction Complexity: While deep learning offers advantages, the computational cost of reconstruction, even with advanced methods, can still be a consideration, though the paper suggests it's manageable for onboard processing.
  • Future Work: The paper indicates that the demonstrator will also address the feasibility of native encryption and information extraction directly from the acquired CS measurements, enabling onboard data analysis at little computational cost. Further validation with real-world data and in-orbit testing would be logical next steps.

Summary updated

Abstract

Increased spatial resolution and revisit time of payloads operating in the infrared spectral region can offer unprecedented advantages to Earth Observation. This, however, poses several technological challenges, such as large array detector availability and data bandwidth. In this paper, we present a super-resolved demonstrator—based on a compressive sensing architecture—which is being developed to address enhanced performance in terms of at-ground spatial resolution, on-board data processing and encryption functionalities for Earth Observation payloads. The demonstrator’s architecture is here presented, together with its working principle, main features and the approach used for image reconstruction.
BibTeX
@misc{raimondi2021designing,
  author = {Valentina Raimondi and Luigi Acampora and Massimo Baldi and Dirk Berndt and Tiziano Bianchi and Donato Borrelli and Chiara Corti and Francesco Corti and Marco Corti and N. L. J. Cox and Ulrike Dauderstädt and Peter Dürr and Alberto Fruchi and Sara Francés González and Donatella Guzzi and Detlef Kunze and Demetrio Labate and Nicolas Lamquin and Cinzia Lastri and Enrico Magli and Vanni Nardino and Christophe Pache and Lorenzo Palombi and G. Pilato and A. Pollini and Enrico Suetta and Dario Taddei and Davide Taricco and Diego Valsesia and Michael Wagner},
  title = {{Designing a Compressive Sensing Demonstrator of an Earth Observation Payload in the Visible and Medium Infrared: Instrumental Concept and Main Features}},
  year = {2021},
  doi = {10.3390/engproc2021008027},
}
Figure