Pre-Earthquake Ionospheric Perturbation Identification Using CSES Data via Transfer Learning

Pan Xiong, Cheng Long, Huiyu Zhou, R. Battiston, Angelo De Santis, Dimitar Ouzounov, Xuemin Zhang, Xuhui ShenFrontiers in Environmental Science 2021 · DOI

TL;DR

This paper introduces SeqNetQuake, a deep learning model that leverages satellite data to identify ionospheric perturbations preceding earthquakes. By employing a transfer learning approach, SeqNetQuake significantly improves prediction accuracy compared to direct training, offering a promising new tool for earthquake precursor analysis.

What Problem Does This Paper Address?

Predicting earthquakes remains a significant challenge. While many factors are involved, researchers are exploring potential precursors in the Earth's ionosphere, the electrically charged upper region of the atmosphere. Changes in the ionosphere, such as anomalies in electron density, have been observed before seismic events. However, analyzing this complex data to reliably distinguish earthquake-related signals from other atmospheric or geomagnetic disturbances is difficult. Existing methods often rely on case studies or statistical analyses, which can be limited in scope and generalizability. This paper aims to develop a robust, data-driven approach using deep learning to identify these subtle pre-earthquake ionospheric perturbations.

Methods

The core of this research is the SeqNetQuake model, a deep learning architecture that combines Convolutional Neural Networks (CNNs) for feature extraction and Bidirectional Long Short-Term Memory (Bi-LSTM) networks for sequence modeling. This architecture is designed to process time-series data from satellites, identifying patterns indicative of pre-earthquake ionospheric changes.

A key methodological innovation is the use of transfer learning. The authors first train SeqNetQuake on a large, pre-existing dataset (DEMETER) to learn general features of ionospheric disturbances. This pre-trained model is then fine-tuned using a smaller, more recent dataset from the CSES satellite. This approach allows the model to benefit from the extensive knowledge gained from the larger dataset, even when the target dataset is limited.

The data is processed using sliding windows to create sequences of observations. These sequences are then classified into three categories: non-seismic events (class #0), seismic-related data (class #1), and data influenced by solar/magnetic activity (class #2).

Datasets

  • DEMETER (Detection of Electromagnetic Emissions Transmitted from Earthquake Regions): A large dataset collected from 2005 to 2010, used for initial model training. This dataset provided over 6.5 years of data.
  • CSES (China Seismo-Electromagnetic Satellite): A more recent dataset, used for fine-tuning the model via transfer learning and for independent testing. Data from August 2018 to June 2020 was utilized.

Key Insights and Ideas

  • Nighttime Data is Key: Ionospheric conditions are more stable and less disrupted by solar activity during nighttime, making nighttime data significantly more effective for identifying subtle pre-earthquake signals.
  • Optimal Input Sequence Length: The model's performance is sensitive to the length of the input sequence. A sequence length of 20 consecutive observations yielded the best results, suggesting a sweet spot for capturing relevant temporal dynamics without introducing too much noise.
  • Spatial Window Matters: Using a spatial window centered on the earthquake epicenter, defined by the Dobrovolsky radius, proved to be the most effective for capturing the geographical extent of potential precursor signals.
  • Transfer Learning is Crucial: The performance jump from direct training to transfer learning is substantial. This highlights the power of leveraging large, pre-existing datasets to improve model performance on smaller, more specific datasets, especially in data-scarce domains like earthquake precursor analysis.

Key Results

  • SeqNetQuake Performance: When directly trained on CSES data (nighttime, 20-observation sequence, Dobrovolsky radius), SeqNetQuake achieved an F1-score of 0.6792 and an MCC of 0.427.
  • Transfer Learning Boost: The transfer learning approach, using DEMETER for initial training and CSES for fine-tuning, yielded a significant improvement: a 12% increase in F1-score and a 29% increase in MCC compared to direct learning.
  • Superior to Benchmarks: SeqNetQuake-TL (transfer learning) outperformed five other benchmarking classifiers, including CNN and LSTM models, by achieving a 64.2% improvement in MCC and a 24.5% improvement in F1-score over the second-best CNN model on an independent test set.
  • Improved Classification: Transfer learning significantly improved the classification accuracy for all three classes, particularly for class 2 (solar/magnetic activity), which had fewer samples.

Limitations and Future Work

  • Computational Complexity: The authors acknowledge that SeqNetQuake's deep learning architecture is computationally intensive. They suggest that increasing processing resources (CPUs/GPUs) could mitigate this.
  • Generalizability: While the model was trained on global data, further validation on more diverse datasets and for different types of seismic events could enhance its generalizability.
  • Physical Mechanisms: While the study supports hypotheses about lithosphere-atmosphere-ionosphere coupling, further research is needed to fully elucidate the precise physical mechanisms driving these observed perturbations. The authors suggest that their findings support the idea of complex coupling processes.
  • Data Availability: The CSES and DEMETER data are publicly available, enabling further research and validation by the scientific community.

Summary updated

Abstract

During the lithospheric buildup to an earthquake, complex physical changes occur within the earthquake hypocenter. Data pertaining to the changes in the ionosphere may be obtained by satellites, and the analysis of data anomalies can help identify earthquake precursors. In this paper, we present a deep-learning model, SeqNetQuake, that uses data from the first China Seismo-Electromagnetic Satellite (CSES) to identify ionospheric perturbations prior to earthquakes. SeqNetQuake achieves the best performance [F-measure (F1) = 0.6792 and Matthews correlation coefficient (MCC) = 0.427] when directly trained on the CSES dataset with a spatial window centered on the earthquake epicenter with the Dobrovolsky radius and an input sequence length of 20 consecutive observations during night time. We further explore a transferring learning approach, which initially trains the model with the larger Electro-Magnetic Emissions Transmitted from the Earthquake Regions (DEMETER) dataset, and then tunes the model with the CSES dataset. The transfer-learning performance is substantially higher than that of direct learning, yielding a 12% improvement in the F1 score and a 29% improvement in the MCC value. Moreover, we compare the proposed model SeqNetQuake with other five benchmarking classifiers on an independent test set, which shows that SeqNetQuake demonstrates a 64.2% improvement in MCC and approximately a 24.5% improvement in the F1 score over the second-best convolutional neural network model. SeqNetSquake achieves significant improvement in identifying pre-earthquake ionospheric perturbation and improves the performance of earthquake prediction using the CSES data.
BibTeX
@inproceedings{xiong2021pre,
  author = {Pan Xiong and Cheng Long and Huiyu Zhou and R. Battiston and Angelo De Santis and Dimitar Ouzounov and Xuemin Zhang and Xuhui Shen},
  title = {{Pre-Earthquake Ionospheric Perturbation Identification Using CSES Data via Transfer Learning}},
  booktitle = {Frontiers in Environmental Science},
  year = {2021},
  doi = {10.3389/fenvs.2021.779255},
}
Figure