Building Models of Functional Interactions Among Brain Domains that Encode Varying Information Complexity: A Schizophrenia Case Study

Ishaan Batta, Anees Abrol, Zening Fu, Adrian Preda, Theo G.m. van Erp, Vince D. CalhounbioRxiv 2020 · DOI

TL;DR

This paper introduces a novel approach to modeling brain functional interactions by allowing different brain network subnetworks (subdomains) to have varying model complexity. By using Bayesian optimization (TPE) to tune the depth of neural network branches for each subdomain, they achieve improved schizophrenia classification and reveal that brain regions implicated in the disorder require more complex models to extract discriminatory information.

What Problem Does This Paper Address?

Traditional machine learning approaches to neuroimaging data often treat all features or brain regions equally, assuming a uniform complexity in how they encode information. This is problematic because different brain networks likely interact and encode information with varying degrees of complexity. For instance, some interactions might be straightforward, while others involve intricate, non-linear relationships. This assumption of homogeneity can limit both predictive accuracy and our ability to understand which brain interactions are most important for a given condition. The paper specifically addresses this by investigating schizophrenia, a disorder known to involve widespread brain network disruptions, to see if a more flexible modeling approach can yield better insights and predictions.

Methods

The core of the methodology involves a multi-branched Multilayer Perceptron (MLP) architecture. Instead of a single, uniform network, this MLP has separate branches for different "subdomain interactions" (SDIs), which represent functional connectivity between pairs of brain networks. The key innovation is that the depth (number of hidden layers) of each branch can be independently optimized.

To navigate the vast search space of possible branch depths, the authors employ the Tree Parzen Estimator (TPE), a Bayesian optimization algorithm. TPE efficiently explores hyperparameter spaces by building probabilistic models of the objective function (in this case, classification accuracy) and using them to guide the search towards promising configurations. The process involves:

  1. scICA (spatially-constrained Independent Component Analysis): Used to identify functional brain networks (components) from fMRI data.
  2. Functional Connectivity Calculation: Static correlations between the time courses of these components are computed to create a functional connectivity matrix.
  3. Subdomain Interaction (SDI) Definition: These connectivity features are grouped into 28 SDIs, representing intra-network (within a network) and inter-network (between networks) connections.
  4. Multi-branched MLP Architecture: Each SDI serves as input to a dedicated branch of the MLP. The number of fully connected hidden layers in each branch is the hyperparameter to be optimized.
  5. TPE for Hyperparameter Optimization: TPE is used to find the optimal number of hidden layers (0, 1, or 2) for each of the 28 SDI branches, aiming to maximize classification accuracy.
  6. Model Analysis: After optimization, the learned architectures are analyzed to understand which SDIs require more complex models (deeper branches) and how this relates to their importance in classification.

Datasets

The study utilizes two independent datasets:

  • fBIRN (Function Biomedical Informatics Research Network) dataset: A large dataset with both healthy controls (HC) and individuals with schizophrenia (SZ).
  • COBRE (Center of Biomedical Research Excellence) dataset: Another dataset also containing HC and SZ subjects.

Both datasets consist of resting-state fMRI data. The authors ensured that HC and SZ subjects were matched by age and gender to minimize confounding factors.

Key Insights and Ideas

  • Brain Network Interactions Vary in Complexity: The central hypothesis, supported by the results, is that different functional brain network interactions (SDIs) encode information with varying levels of complexity. This means a "one-size-fits-all" model complexity for all brain interactions is suboptimal.
  • Adaptive Architectures Improve Performance: Allowing model complexity to vary per subdomain interaction leads to better classification performance compared to models with uniform complexity across all branches. This highlights the benefit of flexible, adaptive deep learning architectures for neuroimaging.
  • Schizophrenia-Related Networks Need Deeper Models: Brain regions and their interactions known to be affected in schizophrenia (e.g., cognitive control, visual, and sensorimotor networks) consistently require more complex (deeper) models to extract discriminatory information. This suggests that the underlying neural mechanisms in these affected networks are more intricate.
  • Intra-network vs. Inter-network Complexity: Interestingly, intra-network connections (within a single brain network) generally required shallower models, even though these connections are also implicated in schizophrenia. This suggests that while intra-network disruptions are important, the way information is encoded might be less complex than in certain inter-network interactions.
  • Cross-Dataset Consistency: The patterns of required model depth for specific SDIs were remarkably consistent across the two independent datasets, lending strong support to the findings and suggesting generalizable principles about brain network complexity.

Key Results

  • Improved Classification Accuracy: The TPE-optimized multi-branched MLP achieved a mean prediction accuracy of 0.81 for fBIRN and 0.78 for COBRE on held-out test data. This was significantly higher (p < 0.05) than baseline methods, including uniformly branched MLPs (UNIF0, UNIF1) and a non-branched MLP (MLP1).
  • Consistent Feature Importance: The importance of SDIs learned by the TPE-optimized architecture (in the fusion layer) was highly correlated (0.9 for fBIRN, 0.81 for COBRE) with the importance of the same SDIs in the input layer (functional connectivity features). This indicates that the learned representations are meaningful and retain the predictive power of the original features.
  • Identified Complex Subdomains: Connections involving the cognitive control (CC) to visual (VIS) and sensorimotor (SM) subdomains consistently required deeper models, suggesting more complex information encoding. Auditory (AUD) to VIS subdomain connections also showed this trend.
  • Consistent Depth Patterns: For 19 out of 28 SDIs, the required model depth was identical across both the fBIRN and COBRE datasets, a statistically significant finding (p = 2.09 × 10⁻⁴) indicating a common underlying complexity structure.

Limitations and Future Work

Limitations:

  • The study focused on a specific number of hidden layers (0, 1, or 2) for each branch. While this kept the search space manageable, exploring a wider range of depths or other architectural variations could yield further improvements.
  • The analysis primarily focused on functional connectivity. Integrating structural connectivity or other modalities could provide a more comprehensive understanding.

Future Work:

  • Extend to Other Disorders: Apply this adaptive modeling approach to other brain disorders to identify domain-specific complexity patterns.
  • Explore More Optimization Methods: Investigate other hyperparameter optimization techniques beyond TPE.
  • Increase Model Flexibility: Introduce more types of flexibility in the frameworks, such as automatically determining model structure/depth and incorporating additional measures of model complexity.
  • Multimodal Integration: Extend these frameworks to exploit complex interrelationships from subdomains in a multimodal setting (e.g., combining fMRI with structural MRI or EEG).

Summary updated

Abstract

ABSTRACT Revealing associations among various structural and functional patterns of the brain can yield highly informative results about the healthy and disordered brain. Studies using neuroimaging data have more recently begun to utilize the information within as well as across various functional and anatomical domains (i.e., groups of brain networks). However, most whole-brain approaches assume similar complexity of interactions throughout the brain. Here we investigate the hypothesis that interactions between brain networks capture varying amounts of complexity, and that we can better capture this information by varying the complexity of the model subspace structure based on available training data. To do this, we employ a Bayesian optimization-based framework known as the Tree Parzen Estimator (TPE) to identify, exploit and analyze patterns of variation in the information encoded by temporal information extracted from functional magnetic resonance imaging (fMRI) subdomains of the brain. Using a repeated cross-validation procedure on a schizophrenia classification task, we demonstrate evidence that interactions between specific functional subdomains are better characterized by more sophisticated model architectures compared to less complicated ones required by the others for optimally contributing towards classification and understanding the brain’s functional interactions. We show that functional subdomains known to be involved in schizophrenia require more complex architectures to optimally unravel discriminatory information about the disorder. Our study points to the need for adaptive, hierarchical learning frameworks that cater differently to the features from different subdomains, not only for a better prediction but also for enabling the identification of features predicting the outcome of interest.
BibTeX
@misc{batta2020building,
  author = {Ishaan Batta and Anees Abrol and Zening Fu and Adrian Preda and Theo G.M. van Erp and Vince D. Calhoun},
  title = {{Building Models of Functional Interactions Among Brain Domains that Encode Varying Information Complexity: A Schizophrenia Case Study}},
  year = {2020},
  doi = {10.1101/2020.12.10.420208},
  howpublished = {bioRxiv},
}
Figure