Predicting Alzheimer's disease progression using deep recurrent neural networks

Minh Nguyen, Tong He, Lijun An, Daniel C. Alexander, Jiashi Feng, B. T. Thomas Yeo

TL;DR

This paper introduces a novel "minimal recurrent neural network" (minimalRNN) model for predicting Alzheimer's disease (AD) progression. The model effectively handles missing data and demonstrates strong performance in predicting clinical diagnosis, cognition, and brain changes over several years, outperforming several baseline algorithms.

What Problem Does This Paper Address?

Alzheimer's disease (AD) is a devastating neurodegenerative disease with a long prodromal phase, making early identification crucial for developing effective treatments. Predicting the longitudinal progression of AD is challenging due to the heterogeneity of the disease and the prevalence of missing data in longitudinal studies. Existing methods often struggle with missing data or make strong assumptions about disease trajectories. This paper aims to develop a robust model that can predict multiple AD markers and clinical diagnoses over extended periods, even with incomplete data.

Methods

The core of this work is the development and application of a minimal recurrent neural network (minimalRNN). Unlike more complex RNN architectures like LSTMs, the minimalRNN is designed with fewer parameters to reduce the risk of overfitting, especially with limited data. A key innovation is the "model filling" strategy for handling missing data. Instead of traditional preprocessing techniques like forward or linear filling, the minimalRNN itself is trained to impute missing values during both training and prediction. This "integrative" approach allows the model to learn from and fill in gaps in the longitudinal data. The model was trained on multimodal AD markers and clinical diagnoses from participants.

Datasets

The study utilized data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. This dataset comprises longitudinal data from 1677 participants, including various AD markers and clinical diagnoses collected over multiple timepoints. The data was used for training, validation, and testing the proposed minimalRNN model and baseline algorithms. The study also references the TADPOLE challenge, for which their model was evaluated and ranked.

Key Insights and Ideas

  • "Model Filling" is Superior: The minimalRNN's ability to learn and impute missing data ("model filling") significantly outperformed traditional "preprocessing" methods like forward and linear filling, especially for predicting cognitive scores and ventricular volume. This suggests that an integrative approach to missing data is more effective.
  • MinimalRNN's Efficiency: The minimalRNN, with its reduced complexity compared to LSTMs, achieved comparable or better performance, highlighting the trade-off between model complexity and overfitting, particularly in clinical prediction tasks.
  • Cross-Sectional Utility: Remarkably, the trained minimalRNN model showed similar performance whether trained with longitudinal data or tested with only a single input timepoint. This suggests the model could be valuable even for cross-sectional data, broadening its applicability.
  • Early Prediction Matters: While the model shows promise, the authors emphasize that significant improvements are still needed for clinical utility, as prediction performance naturally degrades over longer time horizons (e.g., 6 years).

Key Results

The minimalRNN model with "model filling" demonstrated superior performance compared to baseline algorithms, including Support Vector Machines (SVM/SVR), Linear State Space (LSS) models, and Long Short-Term Memory (LSTM) models. Specifically:

  • Clinical Diagnosis: The minimalRNN achieved higher diagnostic accuracy (mAUC and BCA) across various subject groups.
  • Cognition and Brain Changes: For predicting ADAS-Cog13 scores and ventricular volume, the minimalRNN achieved lower Mean Absolute Error (MAE), indicating better prediction accuracy.
  • TADPOLE Challenge: An earlier version of the model ranked 5th out of 53 entries in the TADPOLE challenge, and the current version achieved 2nd and 3rd place out of 63 entries, underscoring its competitive performance.
  • Robustness to Input Data: The model performed comparably well using just one input timepoint versus multiple timepoints, suggesting its potential for use with less complete datasets.

Limitations and Future Work

The authors acknowledge that while their model shows promise, significant improvements are still needed for clinical utility, as prediction performance degrades over longer time horizons. Future work could involve:

  • Investigating New Features: Exploring additional features derived from diffusion MRI, arterial spin labeling, or electronic health records (EHR) could enhance prediction accuracy.
  • Exploring Atrophy Patterns: Investigating different atrophy patterns beyond temporal lobe structures might provide more nuanced information for early disease prediction.
  • Non-Deep Learning Approaches: The success of other teams in the TADPOLE challenge using non-deep learning algorithms like XGBoost suggests that exploring hybrid or alternative machine learning approaches could be beneficial.

Summary updated

Abstract

Early identification of individuals at risk of developing Alzheimer's disease (AD) dementia is important for developing disease-modifying therapies. In this study, given multimodal AD markers and clinical diagnosis of an individual from one or more timepoints, we seek to predict the clinical diagnosis, cognition and ventricular volume of the individual for every month (indefinitely) into the future. We proposed and applied a minimal recurrent neural network (minimalRNN) model to data from The Alzheimer's Disease Prediction Of Longitudinal Evolution (TADPOLE) challenge, comprising longitudinal data of 1677 participants (Marinescu et al., 2018) from the Alzheimer's Disease Neuroimaging Initiative (ADNI). We compared the performance of the minimalRNN model and four baseline algorithms up to 6 years into the future. Most previous work on predicting AD progression ignore the issue of missing data, which is a prevalent issue in longitudinal data. Here, we explored three different strategies to handle missing data. Two of the strategies treated the missing data as a “preprocessing” issue, by imputing the missing data using the previous timepoint (“forward filling”) or linear interpolation (“linear filling). The third strategy utilized the minimalRNN model itself to fill in the missing data both during training and testing (“model filling”). Our analyses suggest that the minimalRNN with “model filling” compared favorably with baseline algorithms, including support vector machine/regression, linear state space (LSS) model, and long short-term memory (LSTM) model. Importantly, although the training procedure utilized longitudinal data, we found that the trained minimalRNN model exhibited similar performance, when using only 1 input timepoint or 4 input timepoints, suggesting that our approach might work well with just cross-sectional data. An earlier version of our approach was ranked 5th (out of 53 entries) in the TADPOLE challenge in 2019. The current approach is ranked 2nd out of 63 entries as of June 3rd, 2020.
BibTeX
@inproceedings{nguyen2020predicting,
  author = {Minh Nguyen and Tong He and Lijun An and Daniel C. Alexander and Jiashi Feng and B. T. Thomas Yeo},
  title = {{Predicting Alzheimer's disease progression using deep recurrent neural networks}},
  booktitle = {NeuroImage},
  year = {2020},
  url = {https://openreview.net/forum?id=GNP9h7RRudu},
}
Figure