Variational Autoencoders for Feature Detection of Magnetic Resonance Imaging Data

R. Devon Hjelm, Sergey M. Plis, Vince D. CalhounarXiv 2016 · arXiv

Introduction

In neuroimaging research, Independent Component Analysis (ICA) has long served as the standard for identifying structural features in Magnetic Resonance Imaging (MRI) data. However, ICA is constrained by two primary limitations: its assumption of linearity between raw data and underlying sources, and the "square constraint," which typically requires the number of sources to match the number of inputs. This paper explores the use of Variational Autoencoders (VAEs) as a nonlinear alternative, treating feature extraction as a directed graphical modeling problem to learn more flexible and biologically plausible latent representations of the brain.

Methodology

The authors implemented a VAE architecture specifically tailored for high-dimensional MRI voxel data. The model consists of:

  • Generative Model: A 2-layer feed-forward network (FFN) with 500 softplus units that maps 64 latent variables ($h$) to the observed MRI data ($x$).
  • Inference Model: A corresponding 2-layer recognition network that maps MRI data back into the latent space.
  • Latent Space: Unlike standard VAEs that use Gaussian priors, this model utilizes a Logistic distribution and the reparameterization trick for end-to-end training.
  • Visualization: To interpret the abstract latent space, the authors developed a "fast approximation" projection method. This technique measures how perturbations in a specific latent neuron affect the generated image, allowing researchers to map latent features back to specific anatomical brain regions.

Experimental Setup

The study utilized a dataset comprising 319 subjects: 163 patients diagnosed with schizophrenia and 156 healthy controls. Whole-brain MRIs were segmented into grey matter regions, resulting in 60,465 voxels per subject. The model was trained in an unsupervised manner, meaning it was never explicitly informed of the subjects' clinical diagnoses during the feature learning phase.

Key Results

Biological Plausibility and Localization

The latent variables learned by the VAE were found to map onto recognizable anatomical structures rather than random noise. Key regions identified included the Right Medial Frontal Gyrus, the Precuneus, and the Cerebellum. Notably, VAE features exhibited more spatial overlap than those typically produced by ICA, which the authors suggest may more accurately reflect the functional overlap inherent in brain biology.

Statistical significance of a latent component differentiating schizophrenia patients from healthy controls, showing localized brain regions.

Diagnostic Power

Despite the unsupervised nature of the training, the learned features proved highly discriminative. A simple logistic regression classifier using only the 64 latent features achieved a 67% classification accuracy for schizophrenia, significantly above chance. Several latent components demonstrated high statistical significance ($p < 0.001$) when comparing the patient and control groups.

Correlation Structure

The latent space organized itself in a way that captured complex inter-group and intra-group correlations. This organization reflects the underlying clinical populations, suggesting that the VAE successfully captured the variance associated with the disease state.

Correlation matrix of the learned latent features across the study population, illustrating the organized structure of the latent space.

Discussion and Future Work

While the results are promising, the study is limited by a relatively small sample size (319 subjects) for deep learning standards. The use of simple feed-forward networks also leaves room for improvement; future iterations could employ Convolutional Neural Networks (CNNs) to better exploit the 3D spatial hierarchy of brain anatomy.

Ultimately, the VAE framework's flexibility makes it uniquely suited for multimodal analysis. Future research could integrate MRI, EEG, and clinical data into a unified latent space, potentially leading to more robust biomarkers for complex neurological disorders.

Summary updated

Abstract

Independent component analysis (ICA), as an approach to the blind source-separation (BSS) problem, has become the de-facto standard in many medical imaging settings. Despite successes and a large ongoing research effort, the limitation of ICA to square linear transformations have not been overcome, so that general INFOMAX is still far from being realized. As an alternative, we present feature analysis in medical imaging as a problem solved by Helmholtz machines, which include dimensionality reduction and reconstruction of the raw data under the same objective, and which recently have overcome major difficulties in inference and learning with deep and nonlinear configurations. We demonstrate one approach to training Helmholtz machines, variational auto-encoders (VAE), as a viable approach toward feature extraction with magnetic resonance imaging (MRI) data.
BibTeX
@misc{hjelm2016variational,
  author = {R. Devon Hjelm and Sergey M. Plis and Vince D. Calhoun},
  title = {{Variational Autoencoders for Feature Detection of Magnetic Resonance Imaging Data}},
  year = {2016},
  eprint = {1603.06624},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1603.06624},
}
Figure