Exploiting Multiple EEG Data Domains with Adversarial Learning

David Bethge, Philipp Hallgarten, Ozan Özdenizci, Ralf Mikut, Albrecht Schmidt, Tobias Grosse-Puppendahl

Introduction

Electroencephalography (EEG) provides a non-invasive window into human mental states, yet its application in Brain-Computer Interfaces (BCIs) is hindered by a significant generalization problem. EEG signals are highly susceptible to "domain" noise—variations stemming from individual subject differences, specific hardware configurations, and varying experimental environments. Consequently, models trained on one dataset often fail when applied to another. This research proposes an adversarial learning framework designed to enable multi-source learning, allowing models to extract robust, domain-invariant features from multiple EEG datasets simultaneously.

Methodology: Adversarial Inference

The core of the proposed approach is an adversarial inference architecture designed to suppress dataset-specific "nuisance" information. The system consists of three interconnected components:

  1. Encoder Network: Compresses raw EEG time-series data into a latent representation $h$.
  2. Emotion Classifier: Predicts the user's emotional state (e.g., positive, neutral, or negative) from the latent representation.
  3. Adversary Network: Attempts to identify the source dataset of the EEG sample based on the same latent representation.
The adversarial architecture consists of an encoder, an emotion classifier, and an adversary network designed to ensure domain-invariant feature extraction.

The training process is framed as a minimax game. The encoder is optimized to minimize the emotion classification error while maximizing the error of the adversary. By preventing the adversary from identifying the data source, the encoder is forced to learn features that are universal across different recording setups and experimental protocols.

Experimental Setup and Data Harmonization

The framework was evaluated using four prominent public EEG emotion datasets: SEED, SEED-IV, DEAP, and DREAMER. These datasets vary significantly in their stimuli (film clips vs. music videos), electrode layouts, and emotion models (discrete vs. dimensional).

To create a unified training set, the researchers implemented a rigorous preprocessing pipeline. All signals were downsampled to 128Hz, and a common subset of 14 electrode channels was selected. Furthermore, diverse emotional labels were mapped onto a shared three-state model: negative, neutral, and positive.

Results and Discussion

The primary goal of the adversarial framework is to reduce information leakage—the degree to which a model relies on dataset-specific artifacts rather than neural patterns. The researchers utilized a hyperparameter, $\lambda$, to control the strength of the adversarial regularization.

Comparison of accuracy for the emotion classifier and the domain (dataset) classifier across different values of the adversarial weight λ.

As shown in the results, increasing $\lambda$ successfully drives the adversary's performance toward chance levels, indicating that the latent features become increasingly domain-blind. Specifically, the adversarial approach reduced dataset-related information leakage by 35% compared to standard deep learning baselines.

Crucially, this gain in invariance did not come at a significant cost to classification performance. The model maintained a stable accuracy of approximately 40.5% for 3-class emotion recognition and 58.2% for binary classification. This suggests that the "nuisance" information suppressed by the adversary was not essential for the primary task of emotion detection.

Conclusion and Future Directions

This work demonstrates that adversarial learning is a viable strategy for building more robust BCIs that can leverage diverse data sources. While the current implementation used a "least common denominator" approach for data harmonization, future work could explore more sophisticated methods to preserve high-frequency information and dense electrode arrays. Additionally, the researchers aim to extend the adversarial component to suppress subject-specific variations, moving toward truly universal, subject-independent EEG models.

Summary updated

BibTeX
@inproceedings{bethge2022exploiting,
  author = {David Bethge and Philipp Hallgarten and Ozan Özdenizci and Ralf Mikut and Albrecht Schmidt and Tobias Grosse-Puppendahl},
  title = {{Exploiting Multiple EEG Data Domains with Adversarial Learning}},
  booktitle = {EMBC},
  year = {2022},
  doi = {10.1109/embc48229.2022.9871743},
}
Figure