Predicting risk of late age-related macular degeneration using deep learning

Yifan Peng, Tiarnan D. Keenan, Qingyu Chen, Elvira Agrón, Alexis Allot, Wai T. Wong, Emily Y. Chew, Zhiyong Lu

TL;DR

This paper introduces a novel deep learning framework that combines image analysis with survival models to predict the risk of developing late-stage Age-Related Macular Degeneration (AMD). The model significantly outperforms current clinical standards used by retinal specialists, offering more accurate and nuanced risk predictions, which could revolutionize patient management and clinical trial design.

What Problem Does This Paper Address?

Age-Related Macular Degeneration (AMD) is a leading cause of vision loss, projected to affect hundreds of millions globally. Early identification of individuals at high risk of progressing to the sight-threatening "late" stage is crucial for timely interventions, lifestyle modifications, and patient monitoring. While deep learning has shown promise in diagnosing AMD from retinal images, accurately predicting the risk and timing of progression to late AMD has remained a significant challenge. Existing clinical standards, while useful, have limitations in accuracy, scope, and the ability to incorporate diverse risk factors, and often lack validation on independent datasets.

Methods

The researchers developed a two-step deep learning framework:

  1. Deep Feature Extraction/Grading: A Convolutional Neural Network (CNN), specifically an adaptation of DeepSeeNet, was used to either extract a set of 512 "deep features" from retinal fundus photographs or to directly estimate grades for macular drusen and pigmentary abnormalities. These features are learned by the model and are not pre-defined by human experts.
  2. Survival Analysis: The extracted deep features or DL-generated grades were then fed into a Cox proportional hazards model. This survival model estimates the probability of progression to late AMD (and its subtypes, geographic atrophy (GA) and neovascular AMD (NV)) over time, incorporating participant demographics and genetic information as additional inputs.

This two-step approach is highlighted as an advantage over "end-to-end" black-box models, offering greater transparency and enabling more detailed error analysis.

Datasets

The study utilized two large, well-established longitudinal clinical trial datasets:

  • AREDS (Age-Related Eye Disease Studies): A cohort of 4,757 participants, with data collected between 1992 and 1998.
  • AREDS2: A subsequent cohort of 4,203 participants, with data collected between 2006 and 2008.

For their primary experiments, the researchers pooled data from both studies to create a combined dataset of 3,298 participants, which was split into training (70%), development (10%), and a hold-out test set (20%) of 601 participants. This combined dataset provided a broad spectrum of AMD severity and a high number of progression events. External validation was also performed by training on AREDS and testing on AREDS2.

Key Insights and Ideas

  • Deep Learning Outperforms Human Experts: The deep learning model consistently achieved higher prognostic accuracy than retinal specialists using established clinical standards. This suggests that AI can learn subtle patterns in retinal images that are predictive of future disease progression, potentially surpassing human visual assessment alone.
  • Deep Features are Powerful Predictors: The "deep features" extracted by the CNN, which are not explicitly defined by human knowledge, proved to be highly effective predictors of AMD progression, often outperforming the DL-generated grades of specific features. This highlights the model's ability to discover novel, complex predictive markers.
  • Survival Analysis is Key for Temporal Prediction: Integrating survival analysis with deep learning is crucial for accurately predicting the timing of disease progression, not just the presence of risk. This temporal aspect is vital for clinical decision-making.
  • Generalizability is Enhanced by Diverse Data: Training on a combined dataset from AREDS and AREDS2, which included data from diverse clinical settings and various camera types, contributed to the model's strong generalizability, even when tested on an independent cohort (AREDS2).
  • Genetics Play a Minor Role for DL Models: Interestingly, adding genetic information (even a comprehensive 52-SNP risk score) did not significantly improve the accuracy of the deep learning models, unlike its modest impact on the specialist-based calculator. This suggests the DL models are primarily leveraging image-based information, making them more accessible in clinical practice where genetic data is often unavailable.

Key Results

  • Superior Prognostic Accuracy: The five-year C-statistic for predicting late AMD progression was 86.4% for the deep features/survival model, significantly exceeding the 81.3% and 82.0% achieved by retinal specialists using the Simplified Severity Scale (SSS) and the online calculator, respectively.
  • Accurate Subtype Prediction: The model could predict progression to geographic atrophy (GA) and neovascular AMD (NV) separately, with GA prediction accuracy being particularly high.
  • Risk Ascertainment Above 50%: Unlike some existing standards that saturate at 50% risk prediction, the DL models could accurately assess risks above this threshold, providing more granular information for high-risk individuals.
  • External Validation Success: When trained on AREDS and tested on AREDS2, the DL models maintained substantially higher prognostic accuracy than the existing clinical standards, demonstrating robustness and generalizability.

Limitations and Future Work

  • Treatment Assignment Not Considered: The study acknowledges that treatment assignments (e.g., oral supplements) in the AREDS/AREDS2 trials were not explicitly factored into the models. While this is deemed appropriate given the standard of care, it's a factor to consider.
  • CFP Only: The current framework relies solely on color fundus photography (CFP). Future work will involve extending the framework to multi-modal imaging, including optical coherence tomography (OCT) and fundus autofluorescence, which hold promise for even more accurate AMD diagnosis and risk prediction.
  • Explainability of Deep Features: While deep features offer high predictive power, their complexity can make them less explainable and harder to analyze for errors compared to DL grading of specific features.
  • Software Prototype: The researchers have developed a software prototype that allows researchers to test their model with their own data, offering transparency by providing gradings, predicted SSS, and risk probabilities. This tool could be valuable for further research and eventual clinical adoption.

Summary updated

Abstract

By 2040, age-related macular degeneration (AMD) will affect ~288 million people worldwide. Identifying individuals at high risk of progression to late AMD, the sight-threatening stage, is critical for clinical actions, including medical interventions and timely monitoring. Although deep learning has shown promise in diagnosing/screening AMD using color fundus photographs, it remains difficult to predict individuals’ risks of late AMD accurately. For both tasks, these initial deep learning attempts have remained largely unvalidated in independent cohorts. Here, we demonstrate how deep learning and survival analysis can predict the probability of progression to late AMD using 3298 participants (over 80,000 images) from the Age-Related Eye Disease Studies AREDS and AREDS2, the largest longitudinal clinical trials in AMD. When validated against an independent test data set of 601 participants, our model achieved high prognostic accuracy (5-year C-statistic 86.4 (95% confidence interval 86.2–86.6)) that substantially exceeded that of retinal specialists using two existing clinical standards (81.3 (81.1–81.5) and 82.0 (81.8–82.3), respectively). Interestingly, our approach offers additional strengths over the existing clinical standards in AMD prognosis (e.g., risk ascertainment above 50%) and is likely to be highly generalizable, given the breadth of training data from 82 US retinal specialty clinics. Indeed, during external validation through training on AREDS and testing on AREDS2 as an independent cohort, our model retained substantially higher prognostic accuracy than existing clinical standards. These results highlight the potential of deep learning systems to enhance clinical decision-making in AMD patients.
BibTeX
@inproceedings{peng2020predicting,
  author = {Yifan Peng and Tiarnan D. Keenan and Qingyu Chen and Elvira Agrón and Alexis Allot and Wai T. Wong and Emily Y. Chew and Zhiyong Lu},
  title = {{Predicting risk of late age-related macular degeneration using deep learning}},
  booktitle = {Npj Digit. Medicine},
  year = {2020},
  url = {https://openreview.net/forum?id=3ivBxwZ07qE},
}
Figure