A Convolutional Neural Network to Identify Parkinson’s Disease using Multimodal Retinal Images

Alexander Richardson, Anita Kundu, Ricardo Henao, Terry Lee, B.l. Scott, Dilraj S. Grewal, Sharon FekratAlzheimer 2024 · DOI

TL;DR

This paper presents a convolutional neural network (CNN) capable of identifying Parkinson's Disease (PD) using multimodal retinal images. By leveraging a VGG19 architecture and combining data from OCTA, UWF fundus color, and FAF imaging, the model achieved a high AUC of 0.918, demonstrating the potential of retinal imaging as a non-invasive diagnostic tool for PD.

What Problem Does This Paper Address?

Parkinson's Disease (PD) is a neurodegenerative disorder that affects motor function, but its diagnosis often relies on clinical symptoms that may not appear until significant neurological damage has occurred. There's a pressing need for earlier, non-invasive diagnostic methods. The paper builds on the observation that changes in the brain associated with neurodegenerative diseases can manifest in the retina, which shares similar vascular and neural structures. Previous work has shown success in using retinal imaging to identify Alzheimer's Disease with CNNs. This study aims to bridge this gap by developing and evaluating a CNN specifically for the identification of Parkinson's Disease using a combination of different retinal imaging modalities.

Methods

The researchers employed a deep learning approach, specifically a convolutional neural network (CNN), to analyze multimodal retinal images. They started with a pre-trained VGG19 architecture, a common choice for image recognition tasks, and fine-tuned it for their specific application. The CNN was designed to accept inputs from three different retinal imaging techniques:

  • Ganglion Cell-Inner Plexiform Layer (GC-IPL) thickness color maps: These maps highlight variations in the thickness of a specific retinal layer, which can be indicative of neural health.
  • Optical Coherence Tomography Angiography (OCTA) superficial capillary plexus images: OCTA provides detailed 3D imaging of retinal blood vessels, allowing for the assessment of microvasculature.
  • Ultra-widefield (UWF) fundus color and autofluorescence (FAF) images: These capture a broader view of the retina, including its color and the natural fluorescence emitted by certain retinal tissues.

The model's architecture featured a shared convolutional encoder to extract general features, followed by parallel branches that processed features specific to each imaging modality. These modality-specific features were then combined, and prediction heads generated a final output to classify subjects as having PD or being a control.

Datasets

The study utilized a dataset comprising 1,784 images from 371 eyes of 249 control subjects and 75 eyes of 52 individuals diagnosed with Parkinson's Disease. The data was split for development and testing:

  • Training: 80% of control eyes (296) and 79% of PD eyes (59).
  • Validation: 10% of control eyes (36) and 8% of PD eyes (6).
  • Testing: 10% of control eyes (39) and 14% of PD eyes (10).

This dataset represents a new benchmark for PD detection using multimodal retinal imaging.

Key Insights and Ideas

  • Retina as a Window to the Brain: The study reinforces the concept that the retina can serve as a surrogate for parallel processes occurring in the brain, particularly in neurodegenerative diseases like PD.
  • Multimodal Imaging Synergy: Combining different retinal imaging modalities (OCTA, UWF color, FAF) provides a more comprehensive picture than any single modality alone, leading to improved diagnostic performance.
  • UWF Color Imaging Dominance: Among the tested modalities, ultra-widefield fundus color images emerged as the most effective single input for PD identification, suggesting that macroscopic changes in retinal appearance are highly informative.
  • GC-IPL Thickness as a Less Sensitive Indicator (in this context): While GC-IPL thickness is a known indicator of retinal health, it appeared to be the least effective individual modality for PD detection in this specific CNN model.

Key Results

The best-performing CNN model achieved an Area Under the Curve (AUC) of 0.918, indicating a high level of accuracy in distinguishing between individuals with Parkinson's Disease and control subjects. When individual modalities were analyzed, UWF color images yielded the highest AUC of 0.838, while GC-IPL color maps had the lowest AUC of 0.630.

Limitations and Future Work

The authors acknowledge that the current study's findings are based on a specific dataset and model. They highlight the need for further work to expand the number of images and increase the diversity of the population to improve the model's translatability and generalizability to broader clinical settings. Future research could explore incorporating additional imaging modalities, refining the CNN architecture, and conducting prospective validation studies.

Summary updated

Abstract

Abstract Background Retinal structure and microvasculature may be used as a surrogate for parallel processes in the brain. Previous studies have revealed differences in retinal structure and microvasculature in patients with Parkinson’s disease (PD) compared to cognitively normal controls[1]. Previous work developed a convolutional neural network (CNN) trained on multimodal retinal images that was able to identify Alzheimer’s dementia with an area under the curve (AUC) of 0.841[2]. Herein, we developed a CNN to identify PD. Methods Building upon a pretrained VGG19 architecture, we trained a CNN to receive inputs of ganglion cell‐inner plexiform layer (GC‐IPL) thickness color maps, optical coherence tomography angiography (OCTA) superficial capillary plexus 6x6mm en face images centered on the fovea obtained using the Zeiss Cirrus HD‐5000 with AngioPlex (v11.0.0.29946), ultra‐widefield (UWF) fundus color and autofluorescence (FAF) scanning laser ophthalmoscopy (Optos California) images from patients with a clinical diagnosis of PD and from controls without PD or cognitive impairment. The model consisted of a shared convolutional encoder, parallel image modality specific feature transformations, and prediction heads for all modalities that converge into a single output. Results 1,784 images from 371 eyes of 249 control subjects and 75 eyes of 52 PD subjects were used for development and testing. 296 (80%) control eyes were used for training, 36 (10%) for validation, and 39 (10%) for testing. 59 (79%) PD eyes were used for training, 6 for validation (8%), and 10 (14%) for testing. Our best performing model had an AUC of 0.918. UWF color images proved to be the most effective imaging input (highest AUC 0.838), and GCL‐IPL color maps were the least effective (highest AUC 0.630). Conclusions This CNN was able to successfully identify individuals with a clinical diagnosis of PD. Further work is ongoing to expand the number of images and the diversity of the population to improve translatability. Ma, J.P., et al., Retinal vascular changes in Parkinson’s disease on ultra‐widefield retinal imaging. Investigative Ophthalmology & Visual Science, 2021. 62(8): p. 1779‐1779. Wisely, C.E., et al., Convolutional neural network to identify symptomatic Alzheimer’s disease using multimodal retinal imaging. British Journal of Ophthalmology, 2020. 106: p. 388 ‐ 395.
BibTeX
@inproceedings{richardson2024convolutional,
  author = {Alexander Richardson and Anita Kundu and Ricardo Henao and Terry Lee and B.L. Scott and Dilraj S. Grewal and Sharon Fekrat},
  title = {{A Convolutional Neural Network to Identify Parkinson’s Disease using Multimodal Retinal Images}},
  booktitle = {Alzheimer},
  year = {2024},
  doi = {10.1002/alz.089793},
}
Figure