Abstract
Remote sensors on spacecrafts acquire huge volumes of data that can be processed for other purposes in addition to those they were designed for. The project TECSEL2 was born for the usage of the Gaia AIM/AVU daily pipeline output and solar events data to characterize the response of detectors subjected to strong radiation damage within an environment not protected by the terrestrial magnetic field, the Lagrangian point L2, where Gaia operates. The project also aims at identifying anomalies in the scientific output parameters and relate them to detectors malfunctioning due to radiation damage issues correlating with solar events occurred in the same time range. TECSEL2 actually designs and implements a system based on big data technologies which are the state of art in the fields of data processing and data storage. The final goal of TECSEL2 is not only related to the Gaia project, because it provides useful analysis techniques for generic and potentially huge time series datasets.
Introduction
Spacecraft operating at the second Lagrangian point (L2), such as ESA’s Gaia mission, reside outside the protective shield of Earth’s magnetosphere. This exposes their sensitive remote sensors—specifically Charge-Coupled Devices (CCDs)—to intense radiation from Solar Energetic Particles (SEPs) and Coronal Mass Ejections (CMEs).
Over time, this radiation causes "Charge Transfer Inefficiency" (CTI), where "traps" created by radiation damage hinder the smooth movement of electrons across the sensor. This results in image blurring and potential data loss. The challenge is twofold: characterizing how specific solar events translate into immediate sensor "noise" and long-term damage, and managing the massive "big data" volumes required to perform this cross-correlation across different space missions.
The TECSEL2 Architecture
To address the scale of high-cadence satellite telemetry, the authors developed the TECSEL2 architecture, a high-performance system designed to handle massive time-series datasets.
- Storage & Processing: The system uses Apache Cassandra as a scalable Time Series Database (TSDB) and Apache Spark for fast, in-memory distributed computing. This allows the team to process roughly 20 million data objects efficiently.
- Statistical Analysis: The core technique is partial correlation with iterative time-shifting. Because solar events are often measured at the L1 point (closer to the Sun) by other satellites, there is a physical delay before those particles reach Gaia at L2.
Data Correlation and the L1-L2 Lag
The study integrates Gaia’s CCD background levels with the OMNI Dataset, which provides "ground truth" for the space environment (proton flux, flow pressure) from satellites located at the L1 point.
The most significant finding was a correlation peak at approximately 3.5 to 4 hours. This delay is physically consistent with solar wind traveling at 200 km/s from the L1 monitoring point to the L2 position. This demonstrates that science data intended for mapping stars can be effectively repurposed as engineering data to monitor instrument health.
Key Results and Future Directions
The researchers successfully validated the correlation between OMNI proton density and Gaia’s background noise levels. Using a 5-minute shift interval, they pinpointed that higher particle activity shows its effect on Gaia almost exactly four hours later.
Future work involves refining algorithms to filter out the 6-hour periodicity corresponding to Gaia’s own rotation period to isolate pure solar effects. While focused on Gaia, the TECSEL2 system is intended to be a generic tool for any mission dealing with massive time-series datasets in harsh environments.
Summary updated