A lightweight convolutional neural network for assessing an EEG risk marker for sudden unexpected death in epilepsy

Cong Zhu, Yejin Kim, Xiaoqian Jiang, Samden D. Lhatoo, Hampson Jaison, Guo-Qiang ZhangBMC Medical Informatics Decis. Mak 2020 · OpenReview

TL;DR

Researchers developed a lightweight Convolutional Neural Network (CNN) to identify a specific EEG pattern (postictal generalized EEG suppression) that predicts the risk of Sudden Unexpected Death in Epilepsy (SUDEP). This model offers a promising balance between accuracy and computational efficiency, potentially enabling real-time SUDEP risk assessment.

What Problem Does This Paper Address?

Sudden Unexpected Death in Epilepsy (SUDEP) is a significant concern, and identifying individuals at higher risk is crucial for prevention. A known marker for SUDEP is "postictal generalized EEG suppression" (PGES), which appears after generalized convulsive seizures. However, manually identifying PGES in EEG recordings is labor-intensive and requires expert knowledge, making it impractical for widespread clinical use. This paper aims to automate this process by developing a computationally efficient deep learning model capable of accurately detecting PGES. The authors also explore the trade-off between model complexity and predictive power, as well as the impact of EEG signal preprocessing on performance.

Methods

The core of this research is a lightweight Convolutional Neural Network (CNN) designed for efficiency. The authors explored three architectural variations:

  • Baseline CNN: A shallow CNN architecture.
  • "RGB" Channel Input: This variation transformed the EEG input from 13 electrodes into a 3-channel format, analogous to RGB image channels, to better capture spatial correlations between electrodes.
  • ResNet Integration: Residual Network (ResNet) blocks were incorporated into the bottleneck of the CNN to potentially improve gradient flow and learning of deeper features.

To prepare the EEG data, the researchers applied a Hann function for signal smoothing, evaluating different window lengths to assess the impact of denoising on model performance. They also employed data augmentation techniques, including sliding window cropping and resampling of short clips, to address the imbalance between positive (PGES) and negative EEG samples and improve model robustness.

Datasets

The study utilized EEG data from 170 patients.

  • Training and Internal Validation: 134 patients were used, with the data further split into 80% for training and 40% for internal validation.
  • External Testing: 36 patients were held out as an independent external testing set.
  • Data Snippets: 10-second clips were sampled from the original EEG recordings. For the external test set, 12,345 snippets were generated using a 10-second sliding window with a 0.1-second step.

Key Insights and Ideas

  • Lightweight is Right: A surprisingly simple, lightweight CNN architecture can achieve competitive performance for complex EEG analysis tasks, challenging the notion that deeper networks are always superior.
  • Denoising is a Double-Edged Sword: While some denoising (using a moderate Hann window) improved training stability and model reliability, aggressive denoising actually degraded performance, suggesting that some "noise" might contain valuable predictive information.
  • Spatial Correlation Matters, But Not Always How You Think: Converting EEG to an "RGB" format to capture spatial relationships didn't improve accuracy, indicating that the model's inherent structure was sufficient or that this specific representation wasn't optimal.
  • ResNet Can Hurt: Incorporating ResNet, a technique known for improving deep networks, surprisingly worsened the model's performance in this context, highlighting the importance of architecture tailored to the specific problem.
  • Efficiency is Key for Real-Time: The lightweight model's fast prediction time (under 5 seconds for over 12,000 snippets) makes it a strong candidate for real-time SUDEP risk monitoring.

Key Results

  • The baseline lightweight CNN model achieved the best Area Under the ROC Curve (AUC) of 0.72 on the external test set when trained on raw EEG signals.
  • A moderate level of denoising (Hann window length of 3) resulted in a comparable AUC of 0.71 and improved training stability.
  • Increasing the denoising window length beyond 3 led to a decrease in AUC, with window lengths of 11 and 15 yielding AUCs of 0.66 and 0.68, respectively.
  • The "RGB" channel input variation resulted in a slightly lower AUC of 0.7.
  • The ResNet integration significantly impaired performance.
  • The baseline CNN and "RGB" channel models had the shortest training times per epoch (16-18s and 14-23s respectively), while the ResNet model was considerably slower (43-55s).

Limitations and Future Work

  • External Validation: While an external test set was used, the authors acknowledge that future work should involve validation on independent datasets from different institutions or with different equipment to ensure generalizability.
  • Denoising Method: The empirical selection of Hann window sizes for denoising might have removed essential signal variations. More advanced denoising techniques, such as autoencoders, are suggested for future exploration.
  • Hyperparameter Tuning: The authors note that they did not re-optimize hyperparameters after introducing architectural variations (RGB, ResNet). Further tuning could potentially yield better results for these modified models.
  • Robust Denoising and Complex Architectures: Future research should focus on developing more robust denoising methods and exploring how to effectively integrate complex CNN structures (like ResNet) without sacrificing performance or efficiency.
  • Real-time Implementation: The authors plan to evaluate the model in an online, real-time environment.

Summary updated

Abstract

Convolutional neural network (CNN) has achieved state-of-art performance in many electroencephalogram (EEG) related studies. However, the application of CNN in prediction of risk factors for sudden unexpected death in epilepsy (SUDEP) remains as an underexplored area. It is unclear how the trade-off between computation cost and prediction power varies with changes in the complexity and depth of neural nets. The purpose of this study was to explore the feasibility of using a lightweight CNN to predict SUDEP. A total of 170 patients were included in the analyses. The CNN model was trained using clips with 10-s signals sampled from the original EEG. We implemented Hann function to smooth the raw EEG signal and evaluated its effect by choosing different strength of denoising filter. In addition, we experimented two variations of the proposed model: (1) converting EEG input into an “RGB” format to address EEG channels underlying spatial correlation and (2) incorporating residual network (ResNet) into the bottle neck position of the proposed structure of baseline CNN. The proposed baseline CNN model with lightweight architecture achieved the best AUC of 0.72. A moderate noise removal step facilitated the training of CNN model by ensuring stability of performance. We did not observe further improvement in model’s accuracy by increasing the strength of denoising filter. Post-seizure slow activity in EEG is a potential marker for SUDEP, our proposed lightweight architecture of CNN achieved satisfying trade-off between efficiently identifying such biomarker and computational cost. It also has a flexible interface to be integrated with different variations in structure leaving room for further improvement of the model’s performance in automating EEG signal annotation.
BibTeX
@inproceedings{zhu2020lightweight,
  author = {Cong Zhu and Yejin Kim and Xiaoqian Jiang and Samden D. Lhatoo and Hampson Jaison and Guo-Qiang Zhang},
  title = {{A lightweight convolutional neural network for assessing an EEG risk marker for sudden unexpected death in epilepsy}},
  booktitle = {BMC Medical Informatics Decis. Mak},
  year = {2020},
  url = {https://openreview.net/forum?id=VnlQIgVxuH},
}
Figure