Development and validation of a deep learning framework for Alzheimer’s disease classification

Vijaya B. Kolachalama, Shangran Qiu, Prajakta Joshi, Matthew I. Miller, Chonghua Xue, Cody Karjadi, Gary H. Chang, Anant S. Joshi, Brigid Dwyer, Shuhan Zhu, Michelle Kaku, Yan Zhou, Yazan J. Alderazi, Arun Swaminathan, Sachin Kedar, Marie Saint‐Hilaire, Sanford Auerbach, Jing Yuan, E. Alton Sartor, Rhoda AubioRxiv 2019 · DOI

TL;DR

This paper introduces an "explainable" deep learning framework that uses MRI scans to classify Alzheimer's Disease (AD) with high accuracy, outperforming human neurologists in some tests. The framework generates "disease probability maps" that visualize AD risk in the brain, offering a more interpretable and clinically applicable approach to AD diagnosis.

What Problem Does This Paper Address?

Alzheimer's Disease (AD) is a growing global health crisis, but current diagnostic methods, while integrating patient history, cognitive tests, and MRI, are often inconsistently applied and lack sufficient sensitivity and specificity. Existing advanced machine learning approaches, particularly deep learning, have shown promise but often suffer from a lack of external validation and a "black-box" nature, making it difficult to understand why a diagnosis is made. This opacity hinders clinical adoption and the ability to link diagnostic predictions to underlying biological processes.

Methods

The core of this work is a novel deep learning framework that combines a Fully Convolutional Network (FCN) with a Multilayer Perceptron (MLP).

  • FCN for Disease Probability Maps (DPMs): The FCN is trained using a patch-wise strategy on MRI data. It learns to identify AD signatures and generates high-resolution "disease probability maps" (DPMs) that visualize the risk of AD across different brain regions. This approach is computationally efficient and allows for arbitrary input sizes.
  • MLP for Classification: The DPMs generated by the FCN are then used as input for an MLP. The authors explore three MLP models:
  • Model A: Uses DPMs alone.
  • Model B: Uses traditional non-imaging features (age, gender, MMSE score).
  • Model C: Fuses DPMs with non-imaging features for multimodal prediction.

The framework is designed to be "explainable" by providing these visual DPMs, allowing clinicians to see where the model is identifying potential AD pathology.

Datasets

The study utilized four large, independent datasets for training and validation:

  • ADNI (Alzheimer's Disease Neuroimaging Initiative): Used for model training and internal validation (n=417).
  • AIBL (Australian Imaging, Biomarker & Lifestyle Flagship Study of Ageing): Used for external validation (n=382).
  • FHS (Framingham Heart Study): Used for external validation (n=102).
  • NACC (National Alzheimer's Coordinating Center): Used for external validation (n=582).

These datasets represent a diverse range of cohorts, increasing the generalizability of the findings.

Key Insights and Ideas

  • Explainability through Visualization: The generation of DPMs is a crucial innovation, moving beyond "black-box" models to provide interpretable visual cues for AD risk. This allows clinicians to understand the model's reasoning.
  • Multimodal Fusion Outperforms: Combining MRI-derived DPMs with non-imaging clinical data (age, gender, MMSE) consistently yielded the best diagnostic performance across all datasets.
  • Neurologist Performance Benchmark: The study directly compared the deep learning model's performance against a panel of practicing neurologists, providing a valuable clinical benchmark.
  • Correlation with Neuropathology: The model's predicted high-risk regions strongly correlated with postmortem histopathological findings (amyloid-beta and tau pathology), grounding the computational predictions in biological evidence.
  • Computational Efficiency: The patch-wise training strategy for the FCN is highlighted as a computationally efficient method for generating DPMs.

Key Results

The deep learning framework demonstrated strong and consistent performance across multiple independent datasets:

  • Accuracy: Mean accuracy values ranged from 0.815 (FHS) to 0.966 (ADNI).
  • Comparison to Neurologists: The multimodal model (Model C) achieved higher diagnostic accuracy than the average performance of 11 practicing neurologists. For example, on the ADNI test set, Model C achieved an accuracy of 0.963±0.013, while the average neurologist accuracy was 0.823±0.094.
  • Neuropathological Correlation: Predicted high-risk AD regions from the model showed a significant positive correlation with the grade of amyloid-beta and tau pathology in postmortem brain samples.
  • Generalizability: The model's consistent performance across diverse cohorts (ADNI, AIBL, FHS, NACC) suggests strong generalizability.

Limitations and Future Work

  • Case-Control Design: The study used a case-control design, meaning the model is currently best suited for screening individuals already suspected of AD or normal cognition. It may not directly apply to the broader clinical scenario of differentiating AD from other dementias.
  • Potential for Bias: The authors acknowledge that clinical diagnosis criteria (like MMSE and demographic parameters) might introduce bias, which could vary across studies.
  • Future Work: The authors suggest that this framework has significant translational potential beyond AD diagnosis, including highlighting areas of pathophysiology in other diseases. Further validation and exploration of its use with other imaging modalities (like PET) are also promising directions. The potential to aid in non-invasive monitoring of AD development and expand access to care in resource-limited settings is also highlighted.

Summary updated

Abstract

Abstract Alzheimer’s disease (AD) is the primary cause of dementia worldwide ( 1 ), with an increasing morbidity burden that may outstrip diagnosis and management capacity as the population ages. Current methods integrate patient history, neuropsychological testing and magnetic resonance imaging (MRI) to identify likely cases, yet effective practices remain variably-applied and lacking in sensitivity and specificity ( 2 ). Here we report an explainable deep learning strategy that delineates unique AD signatures from multimodal inputs of MRI, age, gender, and mini-mental state examination (MMSE) score. Our framework linked a fully convolutional network (FCN) to a multilayer perceptron (MLP) to construct high resolution maps of disease probability from local brain structure. This enabled precise, intuitive visualization of individual AD risk en route to accurate diagnosis. The model was trained using clinically-diagnosed AD and cognitively normal (NC) subjects from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset (n=417) ( 3 ), and validated on three independent cohorts: the Australian Imaging, Biomarker & Lifestyle Flagship Study of Ageing (AIBL, n=382) ( 4 ), the Framingham Heart Study (FHS, n=102) ( 5 ), and the National Alzheimer’s Coordinating Center (NACC, n=582) ( 6 ). Model performance was consistent across datasets, with mean accuracy values of 0.966, 0.948, 0.815, and 0.916 for ADNI, AIBL, FHS and NACC, respectively. Moreover, our approach exceeded the diagnostic performance of a multi-institutional team of practicing neurologists (n=11), and high-risk cerebral regions predicted by the model closely tracked postmortem histopathological findings. This framework provides a clinically-adaptable strategy for using routinely available imaging techniques such as MRI to generate nuanced neuroimaging signatures for AD diagnosis, as well as a generalizable approach for linking deep learning to pathophysiological processes in human disease.
BibTeX
@misc{kolachalama2019development,
  author = {Vijaya B. Kolachalama and Shangran Qiu and Prajakta Joshi and Matthew I. Miller and Chonghua Xue and Cody Karjadi and Gary H. Chang and Anant S. Joshi and Brigid Dwyer and Shuhan Zhu and Michelle Kaku and Yan Zhou and Yazan J. Alderazi and Arun Swaminathan and Sachin Kedar and Marie Saint‐Hilaire and Sanford Auerbach and Jing Yuan and E. Alton Sartor and Rhoda Au},
  title = {{Development and validation of a deep learning framework for Alzheimer’s disease classification}},
  year = {2019},
  doi = {10.1101/832519},
  howpublished = {bioRxiv},
}
Figure