Revealing brain connectivity: graph embeddings for EEG representation learning and comparative analysis of structural and functional connectivity

Abdullah Almohammadi, Yu–Kai WangFrontiers in Neuroscience 2024 · DOI

TL;DR

Researchers have developed two novel graph-based convolutional neural networks (GCNNs) that transform raw EEG data into "brain graphs" to improve motor imagery classification. By modeling both the physical layout of electrodes (structural connectivity) and the synchronization between brain regions (functional connectivity), their models achieved state-of-the-art accuracy, reaching up to 95.72% in specific frequency bands.

What Problem Does This Paper Address?

Brain-Computer Interfaces (BCIs) rely on accurately interpreting a user's intentions from their brain waves—specifically "motor imagery" (MI), where a person imagines moving a limb without actually doing so.

The challenge lies in the data. EEG signals are noisy, non-stationary, and vary wildly between individuals. Traditional methods often rely on handcrafted features or subject-specific spatial filters, which struggle to generalize to new users. Furthermore, standard deep learning approaches often treat EEG channels as a simple grid or a flat list, ignoring the complex, networked way the brain actually communicates across different regions. This paper aims to bridge that gap by using graph embeddings to represent the brain's underlying connectivity.

Methods

The authors propose two distinct models based on Graph Convolutional Neural Networks (GCNNs):

  1. Adj-CNNM (Adjacency-based): This model focuses on structural connectivity. It builds a graph where each electrode is a node, and edges are created between physically adjacent electrodes based on their 2D positions on the scalp. This allows the network to learn spatial features that are more robust and less dependent on specific subjects compared to traditional spatial filtering.
  2. PLV-CNNM (Phase Locking Value-based): This model focuses on functional connectivity. Instead of looking at physical proximity, it uses the Phase Locking Value (PLV) to measure the synchronization between any two electrodes, regardless of distance. If two distant regions "fire" in sync, the model treats them as connected.

Both models feed these graph representations into a specialized CNN architecture designed to extract features across multiple frequency bands (Delta, Theta, Alpha, Mu, Beta, and Gamma).

Datasets

The study utilized the BCI Competition IV-2a dataset, a gold-standard benchmark in the field.

  • Data: 22-channel EEG recordings.
  • Subjects: 9 healthy participants.
  • Tasks: Four motor imagery classes (imagining movement of the left hand, right hand, both feet, or the tongue).
  • Pre-processing: Signals were bandpass-filtered (0.5–51 Hz) and segmented into 4-second epochs.

Key Insights and Ideas

  • Functional > Structural: The PLV-based model outperformed the adjacency-based model. This confirms that how brain regions communicate (synchronization) is more informative for intent recognition than simply where the electrodes are placed.
  • The Power of Theta: Surprisingly, the $\theta$ (theta) frequency band (4–8 Hz) yielded the highest individual accuracy (95.72%). The authors suggest this is because theta waves are heavily involved in memory recall and attentional focus—key components of mentally "rehearsing" a movement.
  • Automated Feature Localization: Visualization of the learned kernels showed that the models naturally focused on the C3, Cz, and C4 electrodes. These are located over the primary motor cortex, validating that the models were indeed picking up on physiologically relevant signals rather than noise.
  • Overcoming the "Subject-Dependent" Hurdle: By using graph embeddings, the models capture the "topology" of brain activity, which appears more stable across different people than raw signal values.

Key Results

The proposed models showed significant improvements over baseline and state-of-the-art (SOTA) methods like EEGNet and FBCSP:

  • Adj-CNNM Accuracy: 72.77% (surpassing many traditional spatial-filtering methods).
  • PLV-CNNM Accuracy: 75.10% across all bands (1–51 Hz).
  • Frequency-Specific Performance: In the 8–30 Hz range (the most common range for MI), the PLV-CNNM achieved 84.3% accuracy.
  • Peak Performance: The model reached its highest accuracy in the $\theta$ band (95.72%) and the $\delta$ band (93.84%).

Limitations and Future Work

While the results are impressive, the authors note several areas for further exploration:

  • Temporal Dynamics: The current models focus heavily on spatial and functional connectivity but could be improved by better integrating temporal information, perhaps through Recurrent Neural Networks (RNNs) or Attention mechanisms.
  • Cross-Dataset Validation: Testing the models on entirely different datasets would further prove their generalizability.
  • Effective Connectivity: The current study uses undirected graphs (synchronization). Future work could explore "effective connectivity," which looks at the direction of information flow between brain regions.
  • Real-time Application: Moving from benchmark datasets to real-time BCI control in clinical or rehabilitative settings remains the ultimate goal.

Summary updated

Abstract

This study employs deep learning techniques to present a compelling approach for modeling brain connectivity in EEG motor imagery classification through graph embedding. The compelling aspect of this study lies in its combination of graph embedding, deep learning, and different brain connectivity types, which not only enhances classification accuracy but also enriches the understanding of brain function. The approach yields high accuracy, providing valuable insights into brain connections and has potential applications in understanding neurological conditions. The proposed models consist of two distinct graph-based convolutional neural networks, each leveraging different types of brain connectivities to enhance classification performance and gain a deeper understanding of brain connections. The first model, Adjacency-based Convolutional Neural Network Model (Adj-CNNM), utilizes a graph representation based on structural brain connectivity to embed spatial information, distinguishing it from prior spatial filtering approaches dependent on subjects and tasks. Extensive tests on a benchmark dataset-IV-2a demonstrate that an accuracy of 72.77% is achieved by the Adj-CNNM, surpassing baseline and state-of-the-art methods. The second model, Phase Locking Value Convolutional Neural Network Model (PLV-CNNM), incorporates functional connectivity to overcome structural connectivity limitations and identifies connections between distinct brain regions. The PLV-CNNM achieves an overall accuracy of 75.10% across the 1-51 Hz frequency range. In the preferred 8-30 Hz frequency band, known for motor imagery data classification (including α, μ, and β waves), individual accuracies of 91.9%, 90.2%, and 85.8% are attained for α, μ, and β, respectively. Moreover, the model performs admirably with 84.3% accuracy when considering the entire 8-30 Hz band. Notably, the PLV-CNNM reveals robust connections between different brain regions during motor imagery tasks, including the frontal and central cortex and the central and parietal cortex. These findings provide valuable insights into brain connectivity patterns, enriching the comprehension of brain function. Additionally, the study offers a comprehensive comparative analysis of diverse brain connectivity modeling methods.
BibTeX
@inproceedings{almohammadi2024revealing,
  author = {Abdullah Almohammadi and Yu–Kai Wang},
  title = {{Revealing brain connectivity: graph embeddings for EEG representation learning and comparative analysis of structural and functional connectivity}},
  booktitle = {Frontiers in Neuroscience},
  year = {2024},
  doi = {10.3389/fnins.2023.1288433},
}
Figure