Trustworthy Enhanced Multi-view Multi-modal Alzheimer’s Disease Prediction with Brain-wide Imaging Transcriptomics Data

Shan Cong, Zhoujie Fan, Hongwei Liu, Yinghan Zhang, Xin Wang, Haoran Luo, Xiaohui Yao

TL;DR

This paper introduces TMM, a novel framework that integrates brain-wide gene expression data (transcriptomics) with multiple imaging modalities to improve Alzheimer's Disease (AD) prediction. TMM uses graph attention networks to model complex relationships between brain regions and a unique "True-False-Harmonized Class Probability" (TFCP) method to dynamically assess the reliability of each data source, leading to more trustworthy and accurate diagnoses.

What Problem Does This Paper Address?

Alzheimer's Disease (AD) is a progressive neurodegenerative disorder with complex underlying mechanisms. While multimodal approaches combining imaging data have shown promise for AD diagnosis, they often overlook the crucial molecular insights provided by transcriptomics. Existing methods also struggle to account for the fact that the informativeness of different data sources can vary significantly between individuals. This paper aims to bridge this gap by developing a trustworthy multimodal framework that leverages both brain-wide transcriptomics and multiple imaging modalities, while also dynamically adapting to the varying reliability of each data source for individual predictions.

Methods

The core of the TMM framework involves several key innovations:

  • View-Specific Co-functional RRI Networks: TMM constructs "Region of Interest (ROI) Co-function Networks" (RRIs) for both transcriptomics (T-RRI) and each imaging modality (R-RRI). These networks model the functional relationships between brain regions by incorporating insights from both molecular activity (gene expression) and anatomical/functional imaging data.
  • Graph Attention Networks (GATs): GATs are applied to these RRI networks to generate sample-wise embeddings. This allows the model to effectively capture local neighborhood information within each brain region's network.
  • Multi-level Graph Embeddings: To capture richer interactions, GATs are applied in a multi-level strategy, generating embeddings from initial graphs and then from higher-level graphs derived from these initial embeddings. These are then concatenated to form view-specific representations.
  • Cross-View Attention: Attention mechanisms are used to fuse the transcriptomics-derived embeddings (from T-RRI) with each imaging-derived embedding (from R-RRI). This allows the model to learn complementary information between these different data views.
  • True-False-Harmonized Class Probability (TFCP): This novel strategy is designed to estimate the confidence of each modality's prediction. Unlike traditional methods that might be overconfident in incorrect predictions, TFCP considers both the probability of the true class and the probability of false classes. This allows the model to dynamically assess and adapt to the informativeness of each modality for a given sample, leading to more trustworthy predictions.
  • Multi-modal Fusion: Finally, the enriched modal representations, incorporating modality confidence, are fused using cross-modal attention mechanisms for the final AD prediction.

Datasets

  • AHBA (Allen Human Brain Atlas): Used for brain-wide transcriptomics data. The authors processed this data to map gene expression across 116 ROIs, filtering genes based on GWAS data to focus on those relevant to AD.
  • ADNI (Alzheimer's Disease Neuroimaging Initiative): Used for multimodal imaging data. This dataset includes three imaging modalities: AV45-PET, FDG-PET, and VBM-MRI. The data was used for classification tasks with diagnosis labels (NC, EMCI, LMCI, AD).

Key Insights and Ideas

  • Transcriptomics is Crucial for AD Prediction: The paper strongly advocates for the inclusion of transcriptomics data, demonstrating that it provides unique and valuable molecular insights that complement imaging data for AD diagnosis.
  • Modality Informativeness Varies: The core idea behind TFCP is that different data sources (imaging modalities, transcriptomics) are not equally informative for every individual. Dynamically assessing this informativeness is key to building trustworthy models.
  • Graph Structures Capture Complex Relationships: Using graph networks (RRIs) to model co-functional relationships between brain regions is an effective way to integrate complex biological interactions.
  • Trustworthiness Enhances Performance: The TFCP mechanism, by making the model more aware of modality reliability, not only improves trustworthiness but also leads to superior predictive performance.

Key Results

  • Superior Performance: TMM significantly outperforms state-of-the-art multimodal methods across four AD classification tasks (NC vs. AD, NC vs. LMCI, NC vs. EMCI, and EMCI vs. LMCI) on the ADNI dataset. For example, in the NC vs. AD task, TMM achieved an accuracy of 98.0±1.1%, F1 score of 97.7±1.3%, and AUC of 98.3±0.5%, outperforming other methods.
  • Ablation Studies Validate Components: Removing the transcriptomics-derived RRI network or the TFCP module led to a decrease in performance, confirming the importance of these components.
  • Identified Biomarkers: The study identified key ROIs as imaging biomarkers for AD, with regions like the hippocampus, amygdala, and cingulate gyrus consistently appearing across tasks, aligning with existing AD research.

Limitations and Future Work

  • Computational Cost: While not explicitly stated as a limitation, the complexity of multi-view, multi-modal graph networks and attention mechanisms can imply significant computational requirements.
  • Generalizability of TFCP: While TFCP shows promise, further validation across different diseases and datasets would be beneficial.
  • Biomarker Interpretation: While biomarkers are identified, deeper functional analysis and validation of their specific roles in AD progression are suggested for future work. The authors also mention the need for further investigation into the identified ROIs and their roles in AD progression.

Summary updated

Abstract

Brain transcriptomics provides insights into the molecular mechanisms by which the brain coordinates its functions and processes. However, existing multimodal methods for predicting Alzheimer’s disease (AD) primarily rely on imaging and sometimes genetic data, often neglecting the transcriptomic basis of brain. Furthermore, while striving to integrate complementary information between modalities, most studies overlook the informativeness disparities between modalities. Here, we propose TMM, a trusted multiview multimodal graph attention framework for AD diagnosis, using extensive brain-wide transcriptomics and imaging data. First, we construct view-specific brain regional co-function networks (RRIs) from transcriptomics and multimodal radiomics data to incorporate interaction information from both biomolecular and imaging perspectives. Next, we apply graph attention (GAT) processing to each RRI network to produce graph embeddings and employ cross-modal attention to fuse transcriptomics-derived embedding with each imaging-derived embedding. Finally, a novel true-false-harmonized class probability (TFCP) strategy is designed to assess and adaptively adjust the prediction confidence of each modality for AD diagnosis. We evaluate TMM using the AHBA database with brain-wide transcriptomics data and the ADNI database with three imaging modalities (AV45-PET, FDG-PET, and VBM-MRI). The results demonstrate the superiority of our method in identifying AD, EMCI, and LMCI compared to state-of-the-arts. Code and data are available at https://github.com/Yaolab-fantastic/TMM.
BibTeX
@misc{cong2024trustworthy,
  author = {Shan Cong and Zhoujie Fan and Hongwei Liu and Yinghan Zhang and Xin Wang and Haoran Luo and Xiaohui Yao},
  title = {{Trustworthy Enhanced Multi-view Multi-modal Alzheimer’s Disease Prediction with Brain-wide Imaging Transcriptomics Data}},
  year = {2024},
  eprint = {2406.14977},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2406.14977},
}
Figure