Evidence of Task-Independent Person-Specific Signatures in EEG Using Subspace Techniques

Mari Ganesh Kumar, Shrikanth Narayanan, Mriganka Sur, Hema A. Murthy

TL;DR

Researchers have successfully adapted subspace techniques from speaker recognition (i-vectors and x-vectors) to identify individuals via EEG signals, regardless of the mental task they are performing. By "normalizing" the variance caused by different activities, the proposed ix-vector system achieves high recognition accuracy across mismatched tasks and recording sessions, even using as few as nine EEG channels.

What Problem Does This Paper Address?

Most EEG-based person recognition systems are "task-dependent." This means if you are enrolled in a system while resting with your eyes closed, the system might fail to recognize you if you are later tested while performing mental math or watching a video. These systems capture the brain's state (the task) rather than the brain's trait (the individual).

The challenge is that EEG signals are highly "noisy" and vary significantly based on a person's internal state, the specific elicitation protocol used, and even the physical placement of sensors across different sessions. This paper tackles the "task-independent" problem: Is there a permanent, person-specific "brainprint" that persists across different mental activities and recording sessions?

Methods

The authors draw inspiration from text-independent speaker recognition, where a system must identify a speaker regardless of the words they are saying. They adapt two state-of-the-art frameworks:

  1. Modified i-vector: A generative approach using Gaussian Mixture Models (GMMs). It estimates high-dimensional statistics (means and variances) across time and projects them into a lower-dimensional "total variability" space.
  2. Modified x-vector: A discriminative approach using Deep Neural Networks (DNNs). It uses 1D-convolutional layers to extract frame-level features, which are then pooled into a segment-level embedding.
  3. The "ix-vector": The authors’ primary contribution is a novel fusion of these two. They also modified the standard architectures to handle multi-channel EEG data by concatenating statistics across channels at an intermediate level, which they show is superior to simple early or late fusion.

To make the signatures more robust, they apply Linear Discriminant Analysis (LDA) to the embeddings, which maximizes the distance between different people while minimizing the distance between different tasks for the same person.

Datasets

The study utilizes two distinct datasets to prove scalability and robustness:

  • Dataset 1 (Lab-controlled): 30 healthy subjects performing 12 different tasks (auditory oddball, visual stimuli, motor imagery, etc.) across up to 5 sessions. This dataset used a high-density 128-channel system.
  • Dataset 2 (Clinical/Large-scale): A subset of the Temple University Hospital EEG (TUH-EEG) corpus. It includes 920 subjects recorded in a clinical environment. This is one of the largest subject pools ever used in EEG biometric research, representing "real-world" noisy conditions.

Key Insights and Ideas

  • The Brainprint is Distributed: Person-specific information isn't locked in one region. The authors found that while the Central and Parietal regions are slightly more informative, signatures are present across the entire scalp.
  • Spatial Resolution vs. Practicality: You don't need 128 electrodes to identify someone. The study demonstrates that 9 strategically placed channels (covering frontal, central, parietal, and occipital lobes) provide a sweet spot between computational efficiency and accuracy.
  • Subspace Normalization Works: The "aha moment" is that the same math used to ignore what a person says to focus on who is talking works for the brain. By modeling the "total variability" of the EEG, the system can effectively treat the "task" as a nuisance variable to be normalized away.
  • Scalability to Unseen Subjects: The subspace models can generalize. A system trained on one group of people can still extract meaningful, unique embeddings for a completely new person it has never seen before.

Key Results

  • Top Performance: The combined ix-vector system outperformed all baselines (including EEGNet and CNN-RNN models).
  • Dataset 1 (30 subjects): Achieved 86.4% accuracy and a 5.02% Equal Error Rate (EER) using only 9 channels across mismatched tasks.
  • Dataset 2 (920 subjects): Achieved 35.9% accuracy. While this number seems lower, it is remarkably high for a 920-class problem in a noisy clinical environment with no standardized tasks—proving the approach scales to large populations.
  • Task Independence: When the system was trained on all tasks except the one being tested, it still maintained high accuracy (e.g., ~94% for "Imagining Binary Answers"), proving the signature is truly task-independent.

Limitations and Future Work

  • Clinical Data Noise: The performance drop on Dataset 2 highlights the difficulty of clinical EEG data, which often contains artifacts (seizures, movement) that can mask biometric signatures.
  • Channel Consistency: The current approach requires the same set of channels to be used during training and testing. Future work could explore "channel-independent" models.
  • Long-term Stability: While the paper tests across sessions, the maximum interval was roughly 16 months. More research is needed to see how these "brainprints" change over decades or in the presence of neurodegenerative diseases.
  • Open-Set Verification: Most tests were "closed-set" (picking from a known list). Moving toward "open-set" (deciding if a person is who they claim to be vs. an impostor) remains a challenging frontier for EEG.

Summary updated

Abstract

Electroencephalography (EEG) signals are promising as alternatives to other biometrics owing to their protection against spoofing. Previous studies have focused on capturing individual variability by analyzing task/condition-specific EEG. This work attempts to model biometric signatures independent of task/condition by normalizing the associated variance. Toward this goal, the paper extends ideas from subspace-based text-independent speaker recognition and proposes novel modifications for modeling multi-channel EEG data. The proposed techniques assume that biometric information is present in the entire EEG signal and accumulate statistics across time in a high dimensional space. These high dimensional statistics are then projected to a lower dimensional space where the biometric information is preserved. The lower dimensional embeddings obtained using the proposed approach are shown to be task-independent. The best subspace system identifies individuals with accuracies of 86.4% and 35.9% on datasets with 30 and 920 subjects, respectively, using just nine EEG channels. The paper also provides insights into the subspace model’s scalability to unseen tasks and individuals during training and the number of channels needed for subspace modeling.
BibTeX
@article{kumar2021evidence,
  author = {Mari Ganesh Kumar and Shrikanth Narayanan and Mriganka Sur and Hema A. Murthy},
  title = {{Evidence of Task-Independent Person-Specific Signatures in EEG Using Subspace Techniques}},
  journal = {IEEE Trans. Inf. Forensics Secur.},
  year = {2021},
  url = {https://openreview.net/forum?id=D4ii19pQHc},
}

Loading related content...

Figure