Covariation Informed Graph Slepians for Motor Imagery Decoding

Kostas Georgiadis, Dimitrios A. Adamos, Spiros Nikolopoulos, Nikolaos Laskaris, Ioannis KompatsiarisIEEE Transactions on Neural Systems and Rehabilitation Engineering 2021 · DOI

Abstract

Graph signal processing (GSP) provides signal analytic tools for data defined in irregular domains, as is the case of non-invasive electroencephalography (EEG). In this work, the recently introduced technique of Graph Slepian functions is exploited for the robust decoding of motor imagery (MI) brain activity. The particular technique builds over the concept of graph Fourier transform (GFT) and provides additional flexibility in the subsequent data analysis by incorporating domain knowledge. Based on contrastive learning, we introduce an algorithmic pipeline that attains a data driven and subject specific design of Graph Slepian functions. These functions, by incorporating both the topology of the sensor array and the empirical evidence about the differential functional covariation, act as spatial filters that enhance the information conveyed by the multichannel signal and specifically relates to the participant's intention. The proposed technique for crafting Graph Slepians is incorporated in a MI-decoding scheme, in which the informed projections are fed to a support vector machine (SVM) that casts a prediction regarding the type of intended movement. The employed MI-decoder is evaluated based on two publicly available datasets and its superiority against popular alternatives in the field is established. Computational efficiency is listed among its main advantages, since it involves only simple matrix operations, allowing to consider its use in real-time implementations.

Introduction

Brain-Computer Interfaces (BCIs) aim to translate a user's intent—such as imagining moving a hand (Motor Imagery, or MI)—directly into machine commands. However, decoding these signals from non-invasive EEG is notoriously challenging due to the low signal-to-noise ratio and the complex spatial relationships of brain activity. Standard decoding methods often ignore the "graph-like" nature of the brain, treating sensors as independent points or a simple grid. Furthermore, existing techniques like Common Spatial Patterns (CSP) can be sensitive to noise and do not easily incorporate "domain knowledge" about the brain's physical structure.

This paper addresses these limitations by leveraging Graph Signal Processing (GSP). By incorporating the 2D layout of the sensors into a graph model, the proposed method respects the physical reality of how electrical signals propagate across the scalp. The core innovation is the data-driven design of Graph Slepian functions, which act as spatial filters tailored to the individual user’s brain topology and functional patterns.

Methodology

The authors introduce a pipeline that "crafts" subject-specific Graph Slepian functions through a multi-step process:

  1. Graph Construction: The EEG sensor array is modeled as a graph where nodes represent sensors and edges represent physical proximity.
  2. Selectivity (Spatial Focus): Instead of analyzing the whole brain, a Dominant-Set (DS) algorithm identifies a "sub-graph" of sensors that are most informative. This is achieved via contrastive learning, examining how the covariation (correlation) between sensors changes between two tasks (e.g., imagining left vs. right hand movement).
  3. Bandwidth (Spectral Focus): Signals are constrained to low-frequency graph components, representing "smooth" patterns of activity across the scalp.
  4. Graph Slepians: By solving an optimization problem, the researchers find functions that are perfectly concentrated in both the chosen brain region and the chosen frequency band.
Visual pipeline of the Graph Slepian design process, including sensor layout, connectivity analysis, and feature selection.

These "informed" projections are then fed into a standard Support Vector Machine (SVM) to predict the user's intended movement. The entire pipeline relies on simple matrix operations, making it computationally efficient for real-time applications.

Experimental Setup and Results

The approach was validated on two significant datasets: the MKLab Dataset (22 subjects, including 11 with motor disabilities like Parkinson’s) and Dataset IVa from BCI Competition III (5 able-bodied subjects).

The proposed Graph Slepian (GSL) decoder consistently outperformed standard Graph Fourier Transforms (GFT) and the industry-standard CSP algorithm. A key finding was the system's performance in clinical populations; for subjects with neuromuscular diseases, the GSL decoder reached an average accuracy of 95.01%, significantly higher than GFT (62%) or CSP (59.54%).

Classification accuracy comparison between GSL, GFT, and CSP across multiple subjects.

On the BCI Competition III benchmark, the GSL method achieved an average accuracy of 86.93%, outperforming several popular CSP variants. Furthermore, the system was highly effective at distinguishing a "resting" state from an "active" imagery state with approximately 98% accuracy, suggesting its utility as a reliable "on/off switch" for self-paced BCIs.

Discussion and Conclusion

The results demonstrate that incorporating physical topology and functional covariation significantly enhances MI decoding. The Dominant-Set algorithm consistently localized sensors over the sensorimotor area without prior anatomical instructions, confirming the method captures neurophysiologically relevant data.

While the current study focuses on binary classification, future work will involve adapting the pipeline to multiclass scenarios and testing in live, "closed-loop" settings. Despite these areas for growth, the computational efficiency and high accuracy—especially in subjects with motor disabilities—mark a significant step forward for robust, real-time BCI applications.

Summary updated

Abstract

Graph signal processing (GSP) provides signal analytic tools for data defined in irregular domains, as is the case of non-invasive electroencephalography (EEG). In this work, the recently introduced technique of Graph Slepian functions is exploited for the robust decoding of motor imagery (MI) brain activity. The particular technique builds over the concept of graph Fourier transform (GFT) and provides additional flexibility in the subsequent data analysis by incorporating domain knowledge. Based on contrastive learning, we introduce an algorithmic pipeline that attains a data driven and subject specific design of Graph Slepian functions. These functions, by incorporating both the topology of the sensor array and the empirical evidence about the differential functional covariation, act as spatial filters that enhance the information conveyed by the multichannel signal and specifically relates to the participant's intention. The proposed technique for crafting Graph Slepians is incorporated in a MI-decoding scheme, in which the informed projections are fed to a support vector machine (SVM) that casts a prediction regarding the type of intended movement. The employed MI-decoder is evaluated based on two publicly available datasets and its superiority against popular alternatives in the field is established. Computational efficiency is listed among its main advantages, since it involves only simple matrix operations, allowing to consider its use in real-time implementations.
BibTeX
@article{georgiadis2021covariation,
  author = {Kostas Georgiadis and Dimitrios A. Adamos and Spiros Nikolopoulos and Nikolaos Laskaris and Ioannis Kompatsiaris},
  title = {{Covariation Informed Graph Slepians for Motor Imagery Decoding}},
  journal = {IEEE Transactions on Neural Systems and Rehabilitation Engineering},
  year = {2021},
  doi = {10.1109/tnsre.2021.3049998},
}
Figure