CABrain: A Correlation-Aware Brain Foundation Model for EEG Decoding

SuGil Choi, Mooseop Kim, Chi Yoon JeongarXiv 2026 · arXiv

TL;DR

CABrain is a novel EEG foundation model that improves brain-activity decoding by moving away from "random" learning strategies. By using graph-based positional encoding to capture real neural correlations and an adaptive masking strategy that makes pretraining more challenging, it achieves state-of-the-art performance across ten diverse datasets.

What Problem Does This Paper Address?

Foundation models for Electroencephalography (EEG) typically rely on self-supervised pretraining: you hide (mask) parts of the signal and ask the model to reconstruct them. However, current models face two major hurdles:

  1. The "Image" Fallacy: Most models treat EEG data like a 2D image grid. They stack channels in an arbitrary order and use standard convolutions for positional encoding. In reality, two channels next to each other in a data matrix might be neurologically unrelated, while distant ones might be highly correlated.
  2. Easy-Mode Pretraining: Randomly masking patches often leaves highly correlated neighboring channels visible. The model can "cheat" by simply copying data from a neighbor rather than learning the complex temporal and spatial dependencies of the brain.

CABrain tackles these by making the model "correlation-aware"—ensuring it understands which parts of the brain actually talk to each other.

Methods

The authors introduce two primary innovations within the CABrain framework:

  • GCN-based Conditional Positional Encoding (CPE): Instead of treating EEG channels as a grid, CABrain treats them as nodes in a graph. Edges are defined by the top-K Pearson correlation coefficients between channels. A Graph Convolutional Network (GCN) then generates positional embeddings based on these functional relationships rather than arbitrary spatial proximity.
  • Adaptive Masking via Kernel Density Estimation (KDE): Rather than masking patches at random, CABrain uses KDE to create more difficult reconstruction tasks. It intentionally masks large clusters of correlated channels within a time slot, forcing the model to rely on weaker correlations or long-term temporal dependencies to fill in the blanks.
Figure 2: General framework of raw-signal reconstruction-based EEG foundation models.

The model uses a Transformer backbone with "crisscross attention" to maintain computational efficiency while processing these complex relationships.

Datasets

The model was pretrained on the TUEG (Temple University Hospital EEG Corpus), a massive public dataset. For evaluation, the authors tested CABrain on ten diverse benchmark datasets covering:

  • Mental States: MentalArithmetic (stress), Mumtaz2016 (depression).
  • Motor Imagery: PhysioNet-MI, SHU-MI, BCIC-IV-2a.
  • Clinical/Other: CHB-MIT (seizures), FACED & SEED-V (emotion), ISRUC (sleep), and BCIC2020-3 (imagined speech).

Key Insights and Ideas

  • Correlation > Coordinates: The paper argues that for EEG, functional connectivity (how signals correlate) is a much more robust feature for positional encoding than physical electrode coordinates, which vary by head size and placement.
  • The Difficulty Dial: By using adaptive masking, the researchers found they could "tune" the difficulty of the pretraining task. If the task is too easy (random masking), the model under-learns. If it's too hard (too much masking), the model fails to converge. The KDE approach finds the "Goldilocks" zone.
  • Task-Specific Strengths: Interestingly, the authors noted that Adaptive Masking provided the biggest boost for binary classification tasks (like detecting stress), where global brain states matter most. Conversely, GCN-based CPE was more effective for multi-class tasks (like motor imagery), which require fine-grained spatial discrimination.
Illustration of how random masking (b) often leaves highly correlated channels (purple boxes) unmasked, making the reconstruction task too simple.

Key Results

CABrain demonstrated significant improvements over previous state-of-the-art models like CBraMod and EEGMamba:

  • Overall Performance: The combined model (CABrain-Comb) outperformed the baseline on 8 out of 10 datasets.
  • Accuracy Gains: It achieved an average improvement of 2.46 percentage points across all tasks.
  • Specific Wins: Notable jumps were seen in MentalArithmetic (+7.02%) and BCIC-IV-2a (+7.77%) compared to the previous best-performing baseline.

Limitations and Future Work

The primary limitation identified is the integration challenge: it is difficult to apply adaptive masking and GCN-based encoding simultaneously during pretraining. Because masking zeros out the very features the GCN needs to calculate correlations, the authors currently use a two-step transfer learning approach.

Future work will likely focus on more "principled fusion strategies" that allow these two components to work in tandem from the start, potentially unlocking even higher decoding accuracy for complex brain-computer interface (BCI) applications.

Summary updated

Abstract

Electroencephalography (EEG) foundation models have emerged as promising paradigms for decoding brain activity through large-scale self-supervised pretraining. Notably, most existing approaches employ masked patch reconstruction, in which randomly selected EEG patches are masked and recovered by the network. However, purely random masking may limit representation learning as informative patches from highly correlated channels often remain unmasked, causing the network to underutilize weakly correlated channels or serial dependencies. Furthermore, because these models are typically based on transformer architectures, their performance is influenced by the choice of positional encoding. Although positional encoding has been extensively explored in natural language processing and computer vision, few studies have adapted it to the unique characteristics of EEG signals. To address these limitations, this study introduces a conditional positional encoding method based on graph convolutional networks (GCNs) to explicitly model inter-channel correlations, along with an adaptive masking strategy that enhances representation learning by modulating the difficulty of masked patch reconstruction. To the best of our knowledge, this is the first study to integrate graph-based representations into conditional positional encoding and introduce adaptive masking within EEG foundation model pretraining. Experimental results on ten benchmark datasets demonstrate that the proposed GCN-based positional encoding and adaptive masking strategies, both individually and in combination, achieve state-of-the-art or competitive performance, highlighting their effectiveness in EEG foundation modeling.
BibTeX
@misc{choi2026cabrain,
  author = {SuGil Choi and Mooseop Kim and Chi Yoon Jeong},
  title = {{CABrain: A Correlation-Aware Brain Foundation Model for EEG Decoding}},
  year = {2026},
  eprint = {2611.11782},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.11782},
}
Figure