3D Convolutional Neural Networks for Classification of Alzheimer’s and Parkinson’s Disease with T1-Weighted Brain MRI

Nikhil J. Dhinagar, Sophia I. Thomopoulos, Conor Owens‐Walton, Dimitris Stripelis, José Luis Ambite, Greg Ver Steeg, Daniel Weintraub, Philip A. Cook, Corey T. McMillan, Paul M. ThompsonbioRxiv 2021

TL;DR

This paper introduces a 3D Convolutional Neural Network (CNN) capable of classifying Alzheimer's Disease (AD) and Parkinson's Disease (PD) using standard T1-weighted brain MRI scans. The 3D CNN demonstrates superior performance and better generalization across different imaging centers compared to a traditional radiomics-based random forest model, offering a promising avenue for non-invasive disease screening.

What Problem Does This Paper Address?

Alzheimer's Disease (AD) and Parkinson's Disease (PD) are two of the most prevalent neurodegenerative disorders, affecting millions globally. Early and accurate diagnosis is crucial for effective management and treatment. While structural Magnetic Resonance Imaging (MRI), particularly T1-weighted scans, is widely available and doesn't involve ionizing radiation, its potential for reliably classifying these complex diseases has been an ongoing area of research. Differentiating between early AD and PD can be particularly challenging due to overlapping symptoms. This paper aims to address the need for a robust, automated method to classify AD and PD using readily available T1-weighted MRI data, moving beyond traditional group-level analyses to individual patient classification.

Methods

The core of this work is a custom-built 3D Convolutional Neural Network (CNN). Unlike 2D CNNs that process MRI slices individually, this 3D CNN takes the entire volumetric T1-weighted MRI scan as input, allowing it to capture spatial relationships across all dimensions. The architecture consists of four modules, each containing convolutional, max-pooling, and batch normalization layers for feature extraction. These are followed by a global average pooling layer, a fully connected layer, and a sigmoid activation for binary classification.

As a baseline, the researchers also implemented a Random Forest classifier. This model relies on radiomics features, which are quantitative descriptors extracted from the MRI images, focusing on texture and intensity patterns within the brain. These features were pre-processed using recursive feature elimination and min-max scaling before being fed into the random forest.

Both models were trained and evaluated using a combination of established datasets and independent test sets to assess generalization capabilities.

Datasets

The study utilized several well-known neuroimaging datasets:

  • Parkinson's Progression Markers Initiative (PPMI): Used for training and testing the PD classification model.
  • Alzheimer's Disease Neuroimaging Initiative (ADNI): Used for training and testing the AD classification model.
  • University of Pennsylvania (UPenn) dataset: An independent dataset used as an out-of-distribution test set for PD classification.
  • Open Access Series of Imaging Studies (OASIS) dataset: An independent dataset used as an out-of-distribution test set for AD classification.

The datasets were partitioned into training, validation, and testing sets. Notably, the UPenn and OASIS datasets were specifically balanced to create independent test sets for evaluating model performance on unseen data from different imaging centers.

Key Insights and Ideas

  • 3D CNNs Excel at Spatial Context: The study strongly suggests that leveraging the full 3D nature of T1-weighted MRI scans with a 3D CNN is crucial for capturing the complex spatial patterns indicative of neurodegenerative diseases, outperforming methods that might overlook these relationships.
  • Generalization is Key: The 3D CNN demonstrated superior generalization performance on independent datasets (UPenn and OASIS) from different imaging centers, indicating its robustness and potential for real-world clinical application.
  • Data Size Matters, But Not Exclusively: While performance generally improved with more training data, the 3D CNN still achieved respectable results even when trained on as little as 25% of the available data, highlighting its efficiency.
  • PD Classification is More Challenging: The paper notes that the 3D CNN was more prone to overfitting on the PD dataset compared to the AD dataset, suggesting that PD classification might be inherently more complex or that the PPMI dataset's class imbalance played a role.

Key Results

  • AD Classification: The 3D CNN achieved an ROC-AUC of 0.878 on the ADNI test set and an average ROC-AUC of 0.789 on the OASIS dataset. This significantly outperformed the random forest classifier (0.730 on ADNI, 0.558 on OASIS).
  • PD Classification: The 3D CNN achieved an ROC-AUC of 0.667 on the PPMI test set and an average ROC-AUC of 0.743 on the UPenn dataset. Again, this surpassed the random forest classifier (0.524 on PPMI, 0.534 on UPenn).
  • Data Augmentation: Figure 6 suggests that data augmentation can be beneficial for improving model performance, potentially by reducing overfitting.
  • Reduced Training Data: The model's performance remained largely stable even with only 25% of the training data, indicating efficient learning.

Limitations and Future Work

The authors acknowledge several limitations and propose future directions:

  • PD Classification Challenges: The higher propensity for overfitting in PD classification suggests that additional imaging modalities (e.g., DAT-PET) or more balanced datasets might be necessary for optimal performance.
  • Dataset Imbalance: The class imbalance in the PPMI dataset for PD classification is identified as a potential factor affecting performance.
  • 2D Variants: The researchers plan to explore 2D CNN variants to potentially mitigate overfitting issues, especially in low-data scenarios.
  • Interpretability: Future work will focus on creating activation maps to improve the interpretability of the model's predictions.
  • Data Harmonization: Investigating MRI data harmonization techniques using generative adversarial networks (like CycleGANs or CALAMITI) is planned to make data from different scanners more comparable.
  • Multi-modal Approaches: The paper hints at the potential value of combining T1-weighted MRI with other imaging protocols or quantitative MRI for enhanced classification.

Summary updated

Abstract

ABSTRACT Parkinson’s disease (PD) and Alzheimer’s disease (AD) are progressive neurodegenerative disorders that affect millions of people worldwide. In this work, we propose a deep learning approach to classify these diseases based on 3D T1-weighted brain MRI. We analyzed several datasets including the Parkinson’s Progression Markers Initiative (PPMI), an independent dataset from the University of Pennsylvania School of Medicine (UPenn), the Alzheimer’s Disease Neuroimaging Initiative (ADNI), and the Open Access Series of Imaging Studies (OASIS) dataset. The UPenn and OASIS datasets were used as independent test sets to evaluate the model performance during inference. We also implemented a random forest classifier as a baseline model by extracting key radiomics features from the same T1-weighted MRI scans. The proposed 3D convolutional neural network (CNN) model was trained from scratch for the classification tasks. For AD classification, the 3D CNN model achieved an ROC-AUC of 0.878 on the ADNI test set and an average ROC-AUC of 0.789 on the OASIS dataset. For PD classification, the proposed 3D CNN model achieved an ROC-AUC of 0.667 on the PPMI test set and an average ROC-AUC of 0.743 on the UPenn dataset. Model performance was largely maintained when using only 25% of the training dataset. The 3D CNN outperformed the random forest classifier for both the PD and AD tasks. The 3D CNN also generalized better on unseen MRI data from different imaging centers. These approaches show promise for screening of PD and AD patients using only T1-weighted brain MRI, which is relatively widely available. This model with additional validation could also be used to help differentiate between challenging cases of AD and PD when they present with similarly subtle motor and non-motor symptoms.
BibTeX
@misc{dhinagar2021d,
  author = {Nikhil J. Dhinagar and Sophia I. Thomopoulos and Conor Owens‐Walton and Dimitris Stripelis and José Luis Ambite and Greg Ver Steeg and Daniel Weintraub and Philip A. Cook and Corey T. McMillan and Paul M. Thompson},
  title = {{3D Convolutional Neural Networks for Classification of Alzheimer’s and Parkinson’s Disease with T1-Weighted Brain MRI}},
  year = {2021},
  howpublished = {bioRxiv},
}
Figure