An Approach to Automatically Label & Order Brain Activity/Component Maps

Mustafa S. Salman, Tor D. Wager, Eswar Damaraju, Vince D. CalhounbioRxiv 2020 · DOI

TL;DR

This paper introduces "Autolabeller," a novel toolbox that automates the complex process of identifying, labeling, and organizing brain activity maps derived from fMRI data. By integrating artifact detection, anatomical/functional labeling, and network ordering, Autolabeller significantly speeds up and standardizes fMRI analysis, making research more reproducible.

What Problem Does This Paper Address?

Analyzing functional magnetic resonance imaging (fMRI) data, particularly data-driven approaches, involves several time-consuming and expertise-heavy steps. Researchers must first distinguish genuine brain activity patterns (intrinsic connectivity networks or ICNs) from noise and artifacts. Then, these ICNs need to be mapped to known anatomical regions and functional networks. Finally, for analyzing functional network connectivity (FNC), the relationships between these networks need to be systematically ordered for easier interpretation. Manually performing these tasks is not only laborious but also prone to inter-rater variability, hindering reproducibility. This paper addresses the need for an automated, accurate, and integrated solution to streamline these critical fMRI analysis steps.

Methods

The Autolabeller toolbox automates three core processes:

  • ICN/Artifact Separation: It leverages a pretrained, cross-validated elastic-net regularized general linear model (GLM) from the "noisecloud" toolbox. This model is trained to distinguish between ICNs and artifacts using spatio-temporal features extracted from fMRI data.
  • Anatomical and Functional Labeling: The toolbox integrates with established anatomical atlases (like AAL) and functional parcellations (like Yeo 2011, Gordon 2016, CAREN) to label the identified ICNs. It calculates correspondence using methods like Pearson correlation.
  • Functional Network Connectivity (FNC) Reordering: It uses the Brain Connectivity Toolbox (BCT) to reorder FNC matrices. This reordering aims to maximize modularity, placing highly connected networks closer to the main diagonal, thus making the network structure more interpretable.

The toolbox can be used standalone with NIfTI files or integrated with the Group ICA for fMRI (GIFT) toolbox.

Datasets

The study utilized several datasets for training and evaluation:

  • Primary Dataset: Function Biomedical Informatics Research Network (FBIRN) phase-III study, comprising resting-state fMRI data from 186 controls and 176 schizophrenia patients. This dataset was used for training the noisecloud model and for initial testing.
  • Validation Datasets:
    • Centers of Biomedical Research Excellence (COBRE) study (100 controls, 87 schizophrenia patients).
  • Human Connectome Project (HCP) (large-sample controls).
  • Genomic Superstruct Project (GSP) (large-sample controls).

These datasets were used to evaluate the performance and generalizability of the pretrained model.

Key Insights and Ideas

  • Automation is Key for Reproducibility: The paper strongly emphasizes that automating complex fMRI analysis steps like artifact detection and labeling is crucial for improving the reproducibility and scalability of neuroimaging research.
  • Pretrained Models for Efficiency: Providing a pretrained model for ICN/artifact separation significantly reduces the computational burden and expertise required for users, allowing them to achieve good performance with minimal or no training data of their own.
  • Integrated Workflow: The strength of Autolabeller lies in its integration of multiple previously disparate steps into a single, cohesive workflow, simplifying the analysis pipeline.
  • Modularity for Interpretability: Reordering FNC matrices to enhance modularity is a clever way to visualize and interpret complex network interactions, making findings more accessible.

Key Results

  • ICN/Artifact Classification: The pretrained noisecloud model achieved 89% accuracy and 100% precision in classifying ICNs from artifacts on a validation dataset (COBRE), demonstrating high reliability. Accuracy was also strong on other datasets, ranging from 77% to 89% when using only spatial maps (SMs) as features.
  • Labeling Accuracy: For anatomical and functional labeling, the Autolabeller's output agreed with prior work (ground truths) in approximately 68-69% of cases for the FBIRN and COBRE datasets. While lower than manual inspection, this is considered reasonable given the objective, atlas-based criteria used by the tool versus subjective criteria in prior studies.
  • FNC Matrix Reordering: The reordered FNC matrices were visually more interpretable, clearly grouping ICNs into functional domains and highlighting community structures.

Limitations and Future Work

  • Limited Atlas Choices: The Autolabeller currently supports a specific set of anatomical and functional atlases. The authors acknowledge that not all of these cover the entire brain (e.g., cerebellum is not included in all functional atlases) and plan to add support for more atlases in the future.
  • Training Time: While prediction with a pretrained model is fast, training the noisecloud model from scratch can be time-consuming, especially for large datasets. The authors suggest refactoring for parallel processing to mitigate this.
  • Nuisance Covariates: The current analysis did not explicitly regress nuisance covariates like motion parameters during training or testing. The authors note that the noisecloud toolbox can incorporate this information, which could improve robustness.
  • Subjectivity vs. Objectivity: The authors note that the lower agreement with prior work in labeling is expected because their tool uses objective atlas-based criteria, whereas prior work relied on subjective visual inspection. Future work could explore ways to bridge this gap or provide users with more control over the labeling criteria.

Summary updated

Abstract

Abstract Functional magnetic resonance imaging (fMRI) is a brain imaging technique which provides detailed in-sights into brain function and its disruption in various brain disorders. fMRI data can be analyzed using data-driven or region-of-interest based methods. The data-driven analysis of brain activity maps involves several steps, the first of which is identifying whether the maps capture what might be interpreted as intrinsic connectivity networks (ICNs) or artifacts. This is followed by linking the ICNs to known anatomical and/or functional parcellations. Optionally, as in the study of functional network connectivity (FNC), rearranging the connectivity graph is also necessary for systematic interpretation. Here we present a toolbox that automates all these processes under minimal or no supervision with high accuracy. We provide a pretrained cross-validated elastic-net regularized general linear model for the noisecloud toolbox to separate the ICNs from artifacts. We include several well-known anatomical and functional parcellations from which researchers can choose to label the activity maps. Finally, we integrate a method for maximizing the within-domain modularity to generate a more systematically structured FNC matrix. We improve upon and integrate existing techniques and new methods to design this toolbox which can take care of all the above needs. Specifically, we show that our pretrained model achieves 89% accuracy and 100% precision at classifying ICNs from artifacts in a validation dataset. Researchers are generating brain imaging data and analyzing brain activity at an ever-increasing rate. The Autolabeller toolbox can help automate such analyses for faster and reproducible research.
BibTeX
@misc{salman2020approach,
  author = {Mustafa S. Salman and Tor D. Wager and Eswar Damaraju and Vince D. Calhoun},
  title = {{An Approach to Automatically Label \& Order Brain Activity/Component Maps}},
  year = {2020},
  doi = {10.1101/2020.08.31.275578},
  howpublished = {bioRxiv},
}

Loading related content...

Figure