Contrastive learning for neural fingerprinting from limited neuroimaging data

Nikolas Kampel, Farah Abdellatif, N. Jon Shah, Irene Neuner, Jürgen DammersFrontiers in Nuclear Medicine 2024 · DOI

Abstract

The contrastive method showed added value in the "leave subject out" scenario, demonstrating flexibility comparable to correlation-based methods and robustness across different data sizes. These findings suggest that contrastive learning and data augmentation offer a scalable solution for neural fingerprinting, even with limited sample sizes.

Introduction

Neural fingerprinting—the identification of individuals based on unique patterns of brain activity—holds significant promise for personalized medicine and neuroscience. Traditionally, this relies on functional connectivity (FC), which describes the communication patterns between disparate brain regions. However, existing approaches face two significant hurdles. First, deep learning (DL) models typically require massive datasets that are difficult to acquire in neuroimaging. Second, most DL models treat identification as a static classification task, necessitating full retraining whenever a new subject is added to the database.

To address these "bottlenecks," researchers have developed a robust framework that utilizes contrastive learning and a novel data augmentation strategy. This approach achieves nearly 98% accuracy and generalizes to unseen subjects without retraining, offering a scalable solution for high-precision identification even when data is scarce.

Methodology: Contrastive Learning and Data Augmentation

The core innovation of this study lies in moving away from standard multi-class classification toward a contrastive learning paradigm using a Triplet Loss function. Instead of learning to assign a specific label to a subject, the model learns to map brain activity into an "embedding space."

The Triplet Approach

The model is trained on triplets consisting of an anchor (a scan from Subject X), a positive (a different scan from Subject X), and a negative (a scan from Subject Y). The objective is to minimize the distance between the anchor and the positive embedding while maximizing the distance to the negative. This allows the model to learn the underlying relationships and unique features of an individual's brain activity rather than just memorizing labels.

Data Augmentation and Architecture

To overcome the limitations of small sample sizes, the researchers implemented a temporal slicing strategy. Resting-state fMRI (rs-fMRI) scans from the LEMON dataset (138 subjects) were sliced into random segments ranging from 90 to 875 seconds. This not only increased the training volume but also forced the model to identify stable, persistent features within short time windows.

Schematic of the processing and model pipeline for neural fingerprinting. Starting with MSDL-defined brain networks, regional brain activation time courses are extracted and transformed into a connectivity matrix for the deep learning model.

The architecture itself is a streamlined feed-forward neural network. It processes a 39x39 correlation matrix derived from the MSDL atlas, flattens it, and passes it through two hidden layers (512 and 256 units) with batch normalization. This simplicity demonstrates that a sound learning paradigm can outperform complex architectures.

Key Results and Insights

The proposed model demonstrated exceptional performance across several metrics:

  • High Accuracy: The contrastive model achieved ~98% identification accuracy, significantly outperforming the traditional correlation-based baseline of 79.3%.
  • Generalization (Leave-Subject-Out): In the most realistic scenario—identifying subjects the model had never seen during training—it maintained a mean accuracy of 97.1%. This confirms the model's ability to extract universal "fingerprinting" features.
  • Efficiency of Short Segments: Surprisingly, using shorter time segments (90s) for data augmentation improved accuracy and reduced variance. This suggests that the brain's temporal dynamics are sufficiently rich that even brief snapshots contain a unique digital signature.
  • Low-Dimensional Success: Achieving elite performance with only 39 regions of interest suggests that neural fingerprints are encoded in broad, large-scale networks rather than requiring high-resolution spatial data.

Discussion and Future Directions

While the results are compelling, the study identifies areas for further exploration. The LEMON dataset lacks longitudinal data, leaving it unclear if these fingerprints remain stable over years or change with age and disease progression. Additionally, future research must test "site generalizability"—whether a model trained on one scanner can identify subjects scanned elsewhere.

Beyond simple identification, these learned embeddings could serve as powerful biomarkers. By acting as "pretext tasks" for transfer learning, this neural fingerprinting framework may eventually help clinicians identify early signs of neurological disorders or cognitive decline by detecting subtle shifts in an individual's unique brain signature.

Summary updated

Abstract

The contrastive method showed added value in the "leave subject out" scenario, demonstrating flexibility comparable to correlation-based methods and robustness across different data sizes. These findings suggest that contrastive learning and data augmentation offer a scalable solution for neural fingerprinting, even with limited sample sizes.
BibTeX
@inproceedings{kampel2024contrastive,
  author = {Nikolas Kampel and Farah Abdellatif and N. Jon Shah and Irene Neuner and Jürgen Dammers},
  title = {{Contrastive learning for neural fingerprinting from limited neuroimaging data}},
  booktitle = {Frontiers in Nuclear Medicine},
  year = {2024},
  doi = {10.3389/fnume.2024.1332747},
}
Figure