The individualized neural tuning model: Precise and generalizable cartography of functional architecture in individual brains

Ma Feilong, Samuel A. Nastase, Guo Jiahui, Yaroslav O. Halchenko, M. Ida Gobbini, James V. Haxby

TL;DR

This paper introduces the "individualized neural tuning" (INT) model, a novel approach to mapping brain function at a fine-grained, vertex-level resolution. The INT model achieves high accuracy in predicting individual brain responses to new stimuli, even with limited data, paving the way for more personalized neuroscience and brain-based biomarkers.

What Problem Does This Paper Address?

Understanding how individual brains differ in their functional organization is crucial for fields ranging from education to clinical diagnostics. While existing methods often group brain regions into coarse units, they miss the nuanced, vertex-level variations that are key to individual differences. This limitation hinders our ability to precisely map and understand the unique functional architecture of each person's brain, especially when dealing with complex, naturalistic stimuli like movies. The authors aim to bridge this gap by developing a model that captures these fine-grained, individualized differences with high precision and generalizability.

Methods

The core of this work is the Individualized Neural Tuning (INT) model. It builds upon hyperalignment techniques but introduces a novel "warp hyperalignment" (WHA) algorithm. WHA allows for warping of representational geometry, not just topographic alignment, enabling a more accurate capture of individual differences. The model decomposes brain responses into two components: a shared stimulus matrix (S) that captures commonalities across individuals and a stimulus-general, individualized tuning matrix (T) that models each person's unique functional architecture. This decomposition allows for precise mapping at the vertex level. The authors also employ ensemble learning techniques, specifically k-fold bagging, to improve model robustness and generalizability, and to enable out-of-bag cross-validation for performance estimation.

Datasets

The study utilizes two rich fMRI datasets:

  • Forrest dataset: Collected from 15 participants watching the movie "Forrest Gump" for approximately 120 minutes, along with retinotopic mapping and object category localizer data.
  • Raiders dataset: Collected from 23 participants watching the movie "Raiders of the Lost Ark" for approximately 56 minutes, also including localizer data.

These datasets are standard for naturalistic viewing paradigms and provide ample data for training and validating the INT model.

Key Insights and Ideas

  • Vertex-level precision is key: The INT model demonstrates that fine-grained, vertex-level mapping is not only possible but also crucial for capturing individual differences in brain function.
  • Warping is better than just aligning: The novel "warp hyperalignment" algorithm, which accounts for both topographic and representational geometry differences, significantly improves prediction accuracy compared to previous methods.
  • Stimulus-general tuning: The INT model successfully separates stimulus information from individual tuning, allowing for a more robust and generalizable model of brain function.
  • Data efficiency: Remarkably, the INT model can achieve good performance with as little as 10-20 minutes of movie data, making it practical for real-world applications.
  • High specificity: Predicted brain responses are highly specific to the individual, meaning a model trained on one person's data is much more similar to their actual responses than to another person's.

Key Results

  • High Reliability: Within-subject similarities of estimated tuning matrices were significantly higher than between-subject similarities, leading to near-perfect individual identification accuracy (100%).
  • Accurate Prediction: The INT model accurately predicted individualized category-selectivity maps (e.g., for faces) and retinotopic maps, with correlations often exceeding previous state-of-the-art methods. For example, model-predicted face-selectivity maps showed high correlations (Forrest: r = 0.618, Raiders: r = 0.716).
  • Movie Prediction: The model could accurately predict fine-grained brain responses to specific time points in movies, achieving high binary classification accuracy (e.g., 99.0% for Forrest) and respectable multiclass accuracy.
  • Data Efficiency: Satisfactory performance for tasks like individual identification and predicting retinotopic maps was achieved with as little as 10-30 minutes of movie data.

Limitations and Future Work

  • Data Volume: While the model performs well with limited data, performance generally improves with more data, especially for tasks requiring finer-grained predictions.
  • Generalizability to Other Modalities: The current model is primarily trained on fMRI data from movie viewing. Future work could explore its generalizability to other functional profiles, modalities (e.g., EEG, MEG), and even species.
  • Beyond Time-Locked Stimuli: The model's ability to predict brain activations that are not strictly time-locked to movie content (e.g., related to motor actions or cognitive tasks) remains an open question.
  • Biomarker Development: The authors suggest that the "semi-shared" components identified by their model offer a promising avenue for developing robust biomarkers for individual differences in cognition, behavior, and disorders.

Summary updated

Abstract

Quantifying how brain functional architecture differs from person to person is a key challenge in human neuroscience. Current individualized models of brain functional organization are based on brain regions and networks, limiting their use in studying fine-grained vertex-level differences. In this work, we present the individualized neural tuning (INT) model, a fine-grained individualized model of brain functional organization. The INT model is designed to have vertex-level granularity, to capture both representational and topographic differences, and to model stimulus-general neural tuning. Through a series of analyses, we demonstrate that (a) our INT model provides a reliable individualized measure of fine-grained brain functional organization, (b) it accurately predicts individualized brain response patterns to new stimuli, and (c) for many benchmarks, it requires only 10-20 minutes of data for good performance. The high reliability, specificity, precision, and generalizability of our INT model affords new opportunities for building brain-based biomarkers based on naturalistic neuroimaging paradigms.
BibTeX
@inproceedings{feilong2023individualized,
  author = {Ma Feilong and Samuel A. Nastase and Guo Jiahui and Yaroslav O. Halchenko and M. Ida Gobbini and James V. Haxby},
  title = {{The individualized neural tuning model: Precise and generalizable cartography of functional architecture in individual brains}},
  booktitle = {Imaging},
  year = {2023},
  doi = {10.1162/imag\_a\_00032},
}
Figure