GALA: Gallery-Level Alignment for Real-Life Vision Decoding from EEG

Philippe Forest, Giulia Lioi, Mai Pham Quyen, Alix Lamouroux, Javen Shi, Adrien MerliniarXiv 2026 · arXiv

TL;DR

GALA (GAllery-Level Alignment) is a novel label-free calibration method that significantly improves the accuracy of decoding visual images from EEG signals across different people. By incrementally aligning a growing buffer of a new user's unlabeled brain activity to a known "gallery" of possible images, GALA bridges the performance gap between laboratory benchmarks and practical, real-world Brain-Computer Interface (BCI) deployment.

What Problem Does This Paper Address?

Decoding what a person is seeing based solely on their brainwaves (EEG) is a "holy grail" of neurotechnology. While we’ve gotten quite good at this when training and testing on the same person, performance falls off a cliff when we try to use a model on a new subject. On the standard 200-way THINGS-EEG-2 benchmark, accuracy can drop from over 80% (within-subject) to a measly 32% for a new user.

This "cross-subject gap" exists because every brain is different—differences in skull shape, cortical folding, and electrode placement create a unique "spatial mixing" of neural signals for every individual. Traditionally, fixing this requires a tedious calibration session where the user looks at specific images to "label" their brain activity. This is a major hurdle for real-world BCIs.

The authors argue that current evaluation methods (like "zero-shot" or "batch" decoding) don't reflect how a BCI actually works. In reality, a BCI has a known gallery of possible outcomes (e.g., icons on a screen), and it collects unlabeled data continuously as the user operates it.

Methods

The authors introduce a new evaluation setting called incremental transductive calibration. In this scenario, queries arrive one by one, and the system must decode them immediately before adding them to a growing buffer of unlabeled data used for regular recalibration.

To solve this, they propose GALA (GAllery-Level Alignment). GALA treats calibration as a point-cloud registration problem: it tries to map the "cloud" of EEG embeddings onto the "cloud" of known image embeddings in the gallery. Key components include:

  1. Shrinkage Whitening: A technique to center and scale the EEG data. Crucially, it uses a "prior" (the zero-shot model) to stay stable when the buffer is still small.
  2. Hubness Correction (CSLS): In high-dimensional spaces, some points (hubs) tend to be "near" everything, ruining retrieval. GALA uses Cross-domain Similarity Local Scaling to penalize these hubs.
  3. Sinkhorn-Procrustes Alignment: This finds the best rotation to align the EEG and image spaces. Unlike previous methods, GALA estimates the query frequencies—it learns which images the user is looking at more often—to improve the alignment.
The GALA loop: EEG embeddings are whitened, compared to the gallery via CSLS, and registered using Sinkhorn-Procrustes alignment.

Datasets

The primary benchmark used is THINGS-EEG-2, which contains EEG responses to 1,854 object concepts. For evaluation, they use a 200-way retrieval task. To test robustness, they also evaluate on:

  • Alljoined-1.6M: A massive million-trial EEG-image dataset.
  • THINGS-MEG: A dataset using Magnetoencephalography (MEG) instead of EEG.

Key Insights and Ideas

  • The "Hungarian" Cheat: The authors point out that standard "batch" evaluations often use a one-to-one assignment (the Hungarian algorithm), which assumes every gallery image is queried exactly once. This is a huge "cheat" that inflates accuracy. GALA works without this assumption, handling realistic "skewed" streams where some images are seen often and others never.
  • Priors Matter: When a user first starts, the system has almost no data. GALA uses the initial "zero-shot" decoder as a strong prior, gradually trusting the user's specific data more as the buffer grows.
  • Geometry is King: Using Representational Similarity Analysis (RSA), the authors found that calibration works best when the "geometric structure" of the EEG signals already somewhat resembles the image features, even if the raw accuracy is low.

Key Results

GALA consistently outperforms all other label-free methods across 60 different evaluation settings.

  • Massive Accuracy Boost: On THINGS-EEG-2, it raises top-1 accuracy for a new subject from 28% to 67% after about 53 minutes of use.
  • Consistency: It remained the top-performing method regardless of gallery size (from 25 to 200 images) or how often images were repeated.
  • Superiority over Baselines: On average, GALA was 6.6 points ahead of the next best competing method (SCORE) at the end of the data stream.
Accuracy over time for different stream types. GALA (blue) shows a clear upward trajectory as it learns from the unlabeled buffer.

Limitations and Future Work

While GALA is a major step forward, the authors acknowledge several areas for improvement:

  • Encoder Dependency: The gain from GALA depends on the underlying EEG encoder. If the base model is very poor (as seen on the Alljoined-1.6M dataset), alignment can only do so much.
  • Repetition Requirements: The current benchmark relies on averaging multiple EEG trials (repetitions) to get a clean signal. A truly "real-life" BCI would need to work on single-trial EEG, which is much noisier.
  • Static Galleries: The study assumes a fixed gallery. Future work could explore dynamic galleries that change based on the user's task or context.

In summary, GALA provides a mathematically principled and highly effective way to make brain-decoding technology "plug-and-play" for new users without requiring tedious manual calibration.

Summary updated

Abstract

Neural decoding of visual experience from electroencephalography (EEG) has achieved strong performance in intra-subject settings, but current methods fail to generalize across individuals: on the standard 200-way benchmark THINGS-EEG-2, top-1 accuracy drops from above 80% within subjects to about 32% for an unseen subject. Adapting a pre-trained encoder to new subjects and sessions typically requires labeled data, a bottleneck whose collection time severely limits practical device deployment. In a practical Brain-Computer Interface (BCI), however, the possible outcomes are known in advance and form a gallery of candidates, and the unlabeled EEG of the user accumulates as soon as the device is used. We propose a new setting, incremental transductive calibration, in which the decoder is calibrated regularly on all the unlabeled EEG received so far and on the known gallery, without any labels. This setting is closer to the conditions of a deployed BCI than the zero-shot and batch evaluations in current use. We evaluate it with a protocol in which queries arrive one at a time, with unknown and possibly unequal frequencies, and each query is decoded before it is used for calibration. In this setting, we introduce GALA : GAllery-Level Alignment, a label-free calibration method which registers the unlabeled EEG embeddings onto the gallery through shrinkage whitening, hubness correction and a Sinkhorn--Procrustes alignment with query frequencies estimated from the buffer, updated after every query. On THINGS-EEG-2, with a gallery of 200 images, it raises the top-1 accuracy on a new subject from 28% to 67% over 53 minutes of use. Across 60 evaluation settings that vary the gallery size, the query frequencies and the number of repetitions averaged per query, GALA is the most accurate label-free method in every setting, 6.6 points above the best competing method on average at the end of the stream.
BibTeX
@misc{forest2026gala,
  author = {Philippe Forest and Giulia Lioi and Mai Pham Quyen and Alix Lamouroux and Javen Shi and Adrien Merlini},
  title = {{GALA: Gallery-Level Alignment for Real-Life Vision Decoding from EEG}},
  year = {2026},
  eprint = {2611.24206},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.24206},
}
Figure