Multi-model order spatially constrained ICA reveals highly replicable group differences and consistent predictive results from fMRI data

Xing Meng, Armin Iraji, Zening Fu, Peter Kochunov, Ayşenil Belger, Judy M. Ford, Sara McEwen, Daniel H. Mathalon, Bryon A. Mueller, Godfrey D. Pearlson, Steven G. Potkin, Adrian Preda, Jessica Turner, Theo G.m. van Erp, Jing Sui, Vince D. CalhounbioRxiv 2022 · DOI

TL;DR

This paper introduces a novel framework using multi-model order spatially constrained Independent Component Analysis (scICA) to analyze brain functional connectivity in schizophrenia. This approach reveals consistent, replicable group differences across multiple spatial scales and demonstrates its potential for identifying biomarkers for schizophrenia classification.

What Problem Does This Paper Address?

Studies investigating brain functional networks in complex mental illnesses like schizophrenia using resting-state fMRI (rsfMRI) often struggle with reproducibility. This is attributed to the disorder's complexity, short data acquisition times, and limitations of existing data mining techniques. Traditional blind ICA methods are difficult to compare across studies, while atlas-based approaches can lack sensitivity to individual variations. Spatially constrained ICA (scICA) offers a hybrid solution, but has primarily been used at a single spatial scale. This paper addresses the need for an approach that can capture individual variability, ensure comparability across analyses, and explore functional connectivity at multiple spatial scales simultaneously, which is crucial for understanding complex disorders.

Methods

The core of this work is a novel framework built upon multi-model order spatially constrained ICA (scICA). Unlike traditional scICA that uses a single spatial scale (model order), this approach analyzes fMRI data at multiple scales simultaneously. This allows for the extraction of subject-specific intrinsic connectivity networks (ICNs) and the investigation of functional interactions across these different spatial scales, termed multiscale functional network connectivity (msFNC).

Key steps include:

  1. Multi-model order scICA: Applying scICA with a pre-defined multi-model order ICA template (Neuromark) to extract ICNs for each subject at various spatial resolutions.
  2. msFNC Calculation: Computing the Pearson correlation between ICN timecourses across all model orders to capture cross-scale functional interactions.
  3. Feature Selection: Using the Relief algorithm on msFNC features from one dataset to identify the most predictive connections for schizophrenia classification.
  4. Support Vector Machine (SVM) Classification: Building and validating an SVM model on a separate dataset using the features selected from the first dataset, demonstrating the framework's generalizability and robustness.
  5. Correlation with Symptoms: Investigating the relationship between identified msFNC patterns and schizophrenia symptom severity (PANSS scores).

Datasets

The study utilized two large datasets comprising over 1,600 individuals:

  • Dataset 1: A discovery and validation dataset, consisting of 827 individuals (477 typical controls, 350 schizophrenia patients) recruited from seven sites across three different studies (fBIRN, MPRC, COBRE). This dataset was used for initial feature selection and model building.
  • Dataset 2: A replication dataset, comprising 815 subjects (326 typical controls, 489 schizophrenia patients) recruited from seven hospitals in China. This dataset was used to train and test the classification model, validating the findings from Dataset 1.

Both datasets underwent identical preprocessing pipelines.

Key Insights and Ideas

  • Multi-scale analysis is crucial: The study highlights that examining brain connectivity at multiple spatial scales simultaneously (msFNC) reveals insights that would be missed by single-scale analyses. This is particularly important for complex disorders like schizophrenia.
  • Consistent biomarkers across datasets: The framework successfully identified common predictive features for schizophrenia classification that were consistent across two independent datasets, demonstrating the robustness and replicability of the findings.
  • Specific brain networks implicated: The cerebellum, somatomotor, subcortical, and temporal ICN domains consistently emerged as important for detecting schizophrenia, both in terms of group differences and predictive power.
  • scICA's adaptability: The use of scICA with a multi-model order template proved effective in extracting subject-specific ICNs while maintaining comparability across individuals and studies.

Key Results

  • Classification Performance: The SVM model, trained on features from Dataset 1 and tested on Dataset 2, achieved an average accuracy of 81.4%, with a precision of 82.6%, recall of 87.6%, and an F1 score of 84.9% across 100 iterations.
  • Group Differences: Highly consistent group differences in msFNC were observed between schizophrenia patients and typical controls across both datasets, particularly in connections involving the cerebellum, somatomotor, subcortical, and visual networks.
  • Symptom Correlation: The study found correlations between msFNC patterns and schizophrenia symptom scores (PANSS), with some domains showing stronger associations in one dataset compared to the other, indicating dataset-specific nuances.
  • Feature Importance: 18 common predictive features were identified, primarily falling within the cerebellum, somatomotor, subcortical, and temporal ICN domains. These features showed consistent group differences and signs (positive/negative) across both datasets.

Limitations and Future Work

The authors acknowledge several limitations and suggest future directions:

  • Limited Feature Set: For simplicity, only a small subset (top 1.2%) of top-ranked common ICN features were evaluated. Future work could explore a larger range of scales and evaluate the optimal size of the predictive feature set.
  • Classification Model: The study primarily used SVM as a baseline classifier. Future research could explore more advanced classification models, including deep learning approaches, to potentially improve predictive performance.
  • Feature Selection Methods: The current feature selection was performed on labeled data. Exploring unsupervised feature selection methods for unlabeled data could be beneficial for building predictive models.
  • Replication and Intervention: Further replication on diverse datasets and exploring interventional approaches targeting the identified brain domains are suggested for future work.

Summary updated

Abstract

Abstract Brain functional networks identified from resting fMRI data have the potential to reveal biomarkers for brain disorders, but studies of complex mental illnesses such as schizophrenia (SZ) often yield mixed results across replication studies. This is likely due in part to the complexity of the disorder, the short data acquisition time, and the limited ability of the approaches for brain imaging data mining. Therefore, the use of analytic approaches which can both capture individual variability while offering comparability across analyses is highly preferred. Fully blind data-driven approaches such as independent component analysis (ICA) are hard to compare across studies, and approaches that use fixed atlas-based regions can have limited sensitivity to individual sensitivity. By contrast, spatially constrained ICA (scICA) provides a hybrid, fully automated solution that can incorporate spatial network priors while also adapting to new subjects. However, scICA has thus far only been used with a single spatial scale. In this work, we present an approach using scICA to extract subject-specific intrinsic connectivity networks (ICNs) from fMRI data at multiple spatial scales (ICA model orders), which also enables us to study interactions across spatial scales. We evaluate this approach using a large N (N>1,600) study of schizophrenia divided into separate validation and replication sets. A multi-scale ICN template was estimated and labeled, then used as input into spatially constrained ICA which was computed on an individual subject level. We then performed a subsequent analysis of multiscale functional network connectivity (msFNC) to evaluate the patient data, including group differences and classification. Results showed highly consistent group differences in msFNC in regions including cerebellum, thalamus, and motor/auditory networks. Importantly, multiple msFNC pairs linking different spatial scales were implicated. We also used the msFNC features as input to a classification model in cross-validated hold-out data and also in an independent test data. Visualization of predictive features was performed by evaluating their feature weights. Finally, we evaluated the relationship of the identified patterns to positive symptoms and found consistent results across datasets. The results verified the robustness of our framework in evaluating brain functional connectivity of schizophrenia at multiple spatial scales, implicated consistent and replicable brain networks, and highlighted a promising approach for leveraging resting fMRI data for brain biomarker development.
BibTeX
@misc{meng2022multi,
  author = {Xing Meng and Armin Iraji and Zening Fu and Peter Kochunov and Ayşenil Belger and Judy M. Ford and Sara McEwen and Daniel H. Mathalon and Bryon A. Mueller and Godfrey D. Pearlson and Steven G. Potkin and Adrian Preda and Jessica Turner and Theo G.M. van Erp and Jing Sui and Vince D. Calhoun},
  title = {{Multi-model order spatially constrained ICA reveals highly replicable group differences and consistent predictive results from fMRI data}},
  year = {2022},
  doi = {10.1101/2022.11.02.514809},
  howpublished = {bioRxiv},
}
Figure