Multi-channel Stochastic Variational Inference for the Joint Analysis of Heterogeneous Biomedical Data in Alzheimer's Disease

Luigi Antelmi, Nicholas Ayache, Philippe Robert, Marco Lorenzi

TL;DR

This paper introduces a novel "multi-channel stochastic generative model" for analyzing diverse biomedical data sources simultaneously. By effectively learning a shared latent representation across these heterogeneous channels, the model enables better patient stratification and a deeper understanding of Alzheimer's disease progression, outperforming traditional single-channel approaches.

What Problem Does This Paper Address?

Analyzing complex diseases like Alzheimer's Disease (AD) requires integrating information from various sources, or "channels," such as clinical assessments, genetic tests, and brain imaging. However, simply analyzing these channels independently or using basic correlation methods is insufficient. These approaches struggle to capture the intricate relationships between different data types and can lead to spurious findings, especially with high-dimensional data. The core challenge is to develop a method that can jointly model and interpret these heterogeneous data sources in a principled and generative way, allowing for a more holistic understanding of the disease.

Methods

The authors propose a multi-channel stochastic generative model that assumes a single latent variable ($z$) generates observations across multiple channels ($x_1, \dots, x_C$). This is a departure from traditional methods that often focus on dimensionality reduction without a generative interpretation. The key innovation lies in using Variational Inference to efficiently estimate both the latent variable's distribution and the data generation process.

Specifically, they introduce a cross-reconstruction term in the evidence lower bound (ELBO) of their variational objective. This term encourages each channel's reconstruction to depend on the latent representation inferred from all channels, not just its own. This is a generalization of the Variational Autoencoder (VAE) and Bayesian Canonical Correlation Analysis (BCCA), allowing for simultaneous modeling of multiple channels. For experimental purposes, they focus on a Gaussian linear case, where the generative and variational distributions are Gaussians parameterized by linear transformations. This allows for efficient optimization using stochastic gradient descent and the Adam optimizer.

Datasets

The paper uses two types of datasets:

  • Synthetic Datasets: These are generated according to a specified model (Eq. 4) to systematically evaluate the model's performance under controlled conditions. The paper details how various attributes (number of channels, dimension, latent space dimension, sample size, signal-to-noise ratio) are varied to create different experimental scenarios.
  • Alzheimer's Disease Neuroimaging Initiative (ADNI) Dataset: This real-world dataset comprises clinical and medical imaging data from 504 subjects. The clinical data includes six continuous variables (age, MMSE, ADAS-cog, CDR, FAQ, scholarity), and the imaging data includes structural MRI, FDG-PET, and Amyloid-PET, with measures averaged over 90 brain regions.

Key Insights and Ideas

  • The "Elbow Effect" for Model Selection: The negative lower bound (NLB) serves as a model selection criterion. The authors observe an "elbow effect" in the NLB plot: the loss decreases as the number of fitted latent dimensions increases, then plateaus when the fitted dimensions match the true underlying latent dimensions. This provides a data-driven way to determine the optimal number of latent dimensions.
  • Cross-Channel Information is Crucial: The multi-channel model consistently outperforms single-channel reconstruction, especially when using all available channels. This highlights the value of integrating information across diverse data sources for a more accurate representation and prediction.
  • Physiological Interpretation of Latent Space: In the ADNI dataset, the latent space learned by the model naturally stratifies subjects by disease status (Dementia, MCI, Normal) without explicit supervision. This suggests that the learned latent dimensions capture biologically meaningful variations related to the disease.
  • Generative Parameters Encode Meaningful Relationships: The generative parameters associated with each channel and latent dimension reveal clinically relevant associations. For example, a specific latent dimension in the ADNI data is linked to factors like amyloid deposition, cognitive scores, and disease severity, aligning with existing AD research.

Key Results

  • Synthetic Data: The multi-channel model demonstrates superior data reconstruction compared to single-channel approaches. The model selection criterion (NLB) effectively identifies the true number of latent dimensions, especially when the number of channels is increased. High-dimensional data can sometimes lead to overestimation of latent dimensions, but this can be mitigated by increasing sample size and signal-to-noise ratio.
  • ADNI Data:
    • Model selection using the lower bound suggests an optimal number of 16 latent dimensions.
  • Linear discriminant analysis on the latent variables achieves high classification accuracy for disease status (Dementia, MCI, Normal), with peak performance at 16 and 32 latent dimensions.
  • The learned latent space shows clear stratification of subjects by disease status, even without supervised learning.
  • Generative parameters reveal plausible relationships between latent dimensions and clinical/imaging markers, consistent with AD literature.

Limitations and Future Work

  • Linear Parameterization: The current implementation focuses on Gaussian distributions with linear parameterizations. Future work aims to extend this to non-linear parameterizations using deep neural networks, which could capture more complex relationships.
  • Non-Gaussian Distributions: Exploring non-Gaussian distributions for channels is another avenue for future research.
  • Supervised Clustering: To further enhance classification performance, the authors suggest introducing supervised clustering by adding an appropriate cost function to the lower bound.
  • Sparsity: Incorporating sparsity could help in identifying and interpreting the most informative parameters.
  • General Data Fusion: The general formulation of the proposed method suggests broad applicability as a general data fusion technique beyond biomedical research.

Summary updated

Abstract

The joint analysis of biomedical data in Alzheimer's Disease (AD) is important for better clinical diagnosis and to understand the relationship between biomarkers. However, jointly accounting for heterogeneous measures poses important challenges related to the modeling of the variability and the interpretability of the results. These issues are here addressed by proposing a novel multi-channel stochastic generative model. We assume that a latent variable generates the data observed through different channels (e.g., clinical scores, imaging, ...) and describe an efficient way to estimate jointly the distribution of both latent variable and data generative process. Experiments on synthetic data show that the multi-channel formulation allows superior data reconstruction as opposed to the single channel one. Moreover, the derived lower bound of the model evidence represents a promising model selection criterion. Experiments on AD data show that the model parameters can be used for unsupervised patient stratification and for the joint interpretation of the heterogeneous observations. Because of its general and flexible formulation, we believe that the proposed method can find important applications as a general data fusion technique.
BibTeX
@inproceedings{antelmi2018multi,
  author = {Luigi Antelmi and Nicholas Ayache and Philippe Robert and Marco Lorenzi},
  title = {{Multi-channel Stochastic Variational Inference for the Joint Analysis of Heterogeneous Biomedical Data in Alzheimer's Disease}},
  booktitle = {MLCN/DLF/iMIMIC @ MICCAI},
  year = {2018},
  doi = {10.1007/978-3-030-02628-8\_2},
}
Figure