Multimodal subspace independent vector analysis effectively captures the latent relationships between brain structure and function

Xinhui Li, Peter Kochunov, Tülay Adalı, Rogers F. Silva, Vince D. CalhounbioRxiv 2023 · DOI

TL;DR

This paper introduces Multimodal Subspace Independent Vector Analysis (MSIVA), a novel method for analyzing complex, high-dimensional neuroimaging data from multiple sources (like structural and functional MRI). MSIVA effectively captures intricate relationships between brain structure and function by allowing for flexible, multi-dimensional "subspaces" of neural activity, outperforming existing methods in identifying these latent structures.

What Problem Does This Paper Address?

Neuroscience research often relies on analyzing brain data from different imaging modalities (e.g., structural MRI for anatomy, functional MRI for activity). Understanding how these modalities relate to each other and to behavior is crucial but challenging due to the sheer volume and complexity of the data. Traditional methods often simplify these relationships by assuming simple, one-dimensional connections between brain signals across modalities. However, the true underlying relationships are likely more complex, involving multi-dimensional dependencies. This paper addresses the need for a method that can capture these richer, multi-dimensional latent relationships within and across neuroimaging data.

Methods

The core contribution is Multimodal Subspace Independent Vector Analysis (MSIVA). Unlike previous methods that assume one-dimensional independent sources, MSIVA allows for:

  • Higher-dimensional subspaces: It can model latent sources that span multiple dimensions, reflecting more complex relationships.
  • Flexible subspace structures: MSIVA can identify both "joint" sources (shared across modalities) and "unique" sources (specific to a modality) within subspaces of varying sizes.
  • Initialization strategies: The method uses a novel initialization combining multimodal group principal component analysis (MGPCA) with independent component analysis (ICA) for each modality. This strikes a balance between capturing joint information and avoiding overfitting.
  • Optimization: MSIVA iteratively optimizes source estimates and uses a MISA (Multidataset Independent Subspace Analysis) loss function to find the best-fitting subspace structure.

Datasets

The authors evaluated MSIVA on:

  • Synthetic datasets: Generated to test the method's ability to recover known ground-truth subspace structures.
  • UK Biobank dataset: A large-scale multimodal dataset including structural MRI (sMRI) and resting-state functional MRI (fMRI) from 2907 subjects.
  • Schizophrenia (SZ) patient dataset: A combined dataset from multiple studies, including sMRI and fMRI, comprising 999 patients and controls.

Key Insights and Ideas

  • Beyond 1D: The assumption of one-dimensional latent sources is a significant oversimplification. MSIVA's ability to model higher-dimensional subspaces is key to capturing richer brain dynamics.
  • Initialization matters: The MSIVA initialization strategy, which balances multimodal and unimodal information, proves more effective than purely unimodal or purely multimodal approaches.
  • Subject-level variability: MSIVA can capture subject-level variations within independent subspaces, a capability lacking in traditional methods that assume shared components across all subjects.
  • Biomarker discovery: The identified latent sources are strongly associated with key phenotypes like age, sex, and schizophrenia, suggesting their potential as biomarkers.

Key Results

  • Synthetic data: MSIVA successfully identified ground-truth subspace structures, outperforming a multimodal baseline that struggled with higher-dimensional subspaces.
  • Neuroimaging data: MSIVA consistently yielded lower loss values (indicating better fit) than the unimodal baseline on both the UK Biobank and SZ datasets.
  • Phenotype prediction: Post-CCA (Canonical Correlation Analysis) sources from MSIVA showed strong associations with age, sex, and schizophrenia.
  • Brain-age delta: Voxelwise brain-age gap analysis revealed significant correlations with lifestyle factors and cognitive performance, highlighting MSIVA's ability to link brain age to behavior.
  • Specific findings: MSIVA identified specific brain regions associated with age, sex, and schizophrenia, providing insights into the neural basis of these conditions. For instance, subspace 5 in the UKB dataset showed the strongest age effect, while subspace 2 in the patient dataset was associated with both age and SZ-related effects.

Limitations and Future Work

  • Subspace structure selection: While MSIVA selects the best-fitting structure from a predefined set, exhaustively evaluating all possible structures is computationally intensive.
  • Assumptions: MSIVA assumes cross-modal subspaces have the same dimensionality per modality and unimodal subspaces are one-dimensional. These assumptions might not always hold true.
  • Linear mixing: The method assumes linear mixing of sources, which may not fully capture the complex, nonlinear transformations in fMRI data.
  • Future directions: The authors plan to explore data-driven subspace structures (e.g., using the NeuroMark template) and learn structures directly in an unsupervised manner. They are also developing nonlinear latent variable models to address the linear mixing assumption. Additionally, they suggest using multiple metrics beyond loss value for evaluation and optimizing workflows for higher-dimensional subspaces.

Summary updated

Abstract

A key challenge in neuroscience is to understand the structural and functional relationships of the brain from high-dimensional, multimodal neuroimaging data. While conventional multivariate approaches often simplify statistical assumptions and estimate one-dimensional independent sources shared across modalities, the relationships between true latent sources are likely more complex - statistical dependence may exist within and between modalities, and span one or more dimensions. Here we present Multimodal Subspace Independent Vector Analysis (MSIVA), a methodology to capture both joint and unique vector sources from multiple data modalities by defining both cross-modal and unimodal subspaces with variable dimensions. In particular, MSIVA enables flexible estimation of varying-size independent subspaces within modalities and their one-to-one linkage to corresponding subspaces across modalities. As we demonstrate, a main benefit of MSIVA is the ability to capture subject-level variability at the voxel level within independent subspaces, contrasting with the rigidity of traditional methods that share the same independent components across subjects. We compared MSIVA to a unimodal initialization baseline and a multimodal initialization baseline, and evaluated all three approaches with five candidate subspace structures on both synthetic and neuroimaging datasets. We show that MSIVA successfully identified the ground-truth subspace structures in multiple synthetic datasets, while the multimodal baseline failed to detect high-dimensional subspaces. We then demonstrate that MSIVA better detected the latent subspace structure in two large multimodal neuroimaging datasets including structural MRI (sMRI) and functional MRI (fMRI), compared with the unimodal baseline. From subsequent subspace-specific canonical correlation analysis, brain-phenotype prediction, and voxelwise brain-age delta analysis, our findings suggest that the estimated sources from MSIVA with optimal subspace structure are strongly associated with various phenotype variables, including age, sex, schizophrenia, lifestyle factors, and cognitive functions. Further, we identified modality- and group-specific brain regions related to multiple phenotype measures such as age (e.g., cerebellum, precentral gyrus, and cingulate gyrus in sMRI; occipital lobe and superior frontal gyrus in fMRI), sex (e.g., cerebellum in sMRI, frontal lobe in fMRI, and precuneus in both sMRI and fMRI), schizophrenia (e.g., cerebellum, temporal pole, and frontal operculum cortex in sMRI; occipital pole, lingual gyrus, and precuneus in fMRI), shedding light on phenotypic and neuropsychiatric biomarkers of linked brain structure and function.
BibTeX
@misc{li2023multimodal,
  author = {Xinhui Li and Peter Kochunov and Tülay Adalı and Rogers F. Silva and Vince D. Calhoun},
  title = {{Multimodal subspace independent vector analysis effectively captures the latent relationships between brain structure and function}},
  year = {2023},
  doi = {10.1101/2023.09.17.558092},
  howpublished = {bioRxiv},
}
Figure