Human-level COVID-19 Diagnosis from Low-dose CT Scans Using a Two-stage Time-distributed Capsule Network

Parnian Afshar, Moezedin Javad Rafiee, Farnoosh Naderkhani, Shahin Heidarian, Nastaran Enshaei, Anastasia Oikonomou, Faranak Babaki Fard, Reut Anconina, Keyvan Farahani, Konstantinos N. Plataniotis, Arash MohammadiarXiv 2021 · OpenReview

TL;DR

This paper introduces a novel two-stage capsule network AI model for diagnosing COVID-19 from low-dose CT (LDCT) scans, achieving human-level performance. By reducing radiation exposure and leveraging clinical data, the model offers a promising tool to aid radiologists in rapid and accurate diagnosis, potentially helping to control disease transmission.

What Problem Does This Paper Address?

The gold standard for COVID-19 diagnosis, RT-PCR, is time-consuming and can have a high false-negative rate. While chest CT scans are valuable for diagnosis and assessment, standard-dose CT exposes patients to significant radiation, especially those requiring multiple scans. This poses a particular risk to vulnerable populations like children and young women. Furthermore, during outbreaks, the availability of expert thoracic radiologists can be limited, leading to diagnostic delays and increased transmission. This paper aims to address these challenges by developing an AI model that can accurately diagnose COVID-19 from low-dose CT scans, mimicking human-level diagnostic capabilities while minimizing radiation exposure and overcoming radiologist availability constraints.

Methods

The core of this research is a two-stage deep learning framework built upon capsule networks.

  • Stage 1: Capsule Network for Infection Detection: This stage uses a 2D capsule network to analyze individual CT slices and identify those showing signs of infection (either COVID-19 or Community Acquired Pneumonia - CAP). This stage is trained on slice-level labels provided by an experienced radiologist. The network is designed to capture spatial relationships between image features, which is advantageous for medical imaging. To handle the imbalanced nature of the dataset (more non-infected slices than infected ones), a modified loss function with higher penalties for misclassifying infected slices is employed.
  • Stage 2: Time-Distributed Capsule Network for Classification: The top 10 most probable infected slices identified in Stage 1 are fed into a time-distributed capsule network. This network processes these slices in parallel, sharing weights across them. The output from this stage provides probabilities for COVID-19, CAP, and normal cases. A global max pooling operation aggregates these probabilities to make a final decision.
  • Incorporating Clinical Data: To further enhance diagnostic accuracy, the output probabilities from the two-stage deep learning model are concatenated with clinical data (demographics and symptoms). This combined information is then fed into a multi-layer perceptron (MLP) for the final diagnosis.

The use of capsule networks is highlighted as a key innovation, offering advantages over traditional Convolutional Neural Networks (CNNs) in handling spatial relationships and potentially requiring fewer trainable parameters, thus reducing the risk of overfitting, especially with smaller datasets.

Datasets

The study utilized a dataset comprising:

  • LDCT/ULDCT Scans: Volumetric low-dose and ultra-low-dose chest CT scans from 104 COVID-19 positive cases and 56 healthy cases, collected between October 2020 and January 2021.
  • RT-PCR Confirmation: 36.5% of COVID-19 cases were confirmed via RT-PCR.
  • Radiologist Consensus: The remaining COVID-19 cases were diagnosed by a consensus of three experienced thoracic radiologists.
  • CAP Cases: Due to a lack of LDCT/ULDCT scans for CAP patients, the researchers combined their dataset with 60 standard-dose volumetric CT scans of CAP patients collected prior to the pandemic (April 2018 - December 2019). This resulted in a total of 220 patients for the main study.
  • Extra Validation Set: An additional set of 100 positive COVID-19 patients, confirmed by RT-PCR and collected in April 2021, was used for narrow validation.

The paper also references a previously introduced dataset, "Covid-ct-md, covid-19 computed tomography scan dataset applicable in machine learning and deep learning" (Reference 21), which was used for CAP cases.

Key Insights and Ideas

  • Human-Level Performance with Reduced Radiation: The most significant insight is that an AI model, using low-dose CT scans, can achieve diagnostic performance comparable to experienced human radiologists. This is crucial for making CT a safer and more accessible screening tool.
  • Capsule Networks for Spatial Reasoning: The adoption of capsule networks proves effective in capturing complex spatial relationships within CT scans, which is vital for identifying subtle signs of pneumonia, especially in the context of COVID-19's characteristic multifocal ground-glass opacities.
  • Synergy of Imaging and Clinical Data: The study strongly demonstrates that combining CT imaging data with clinical information (demographics, symptoms) significantly boosts diagnostic accuracy, highlighting the importance of a holistic approach to AI-driven medical diagnosis.
  • Addressing the "No Imaging Findings" Challenge: A notable finding is the AI model's improved, though still limited, ability to detect COVID-19 cases that lack clear imaging findings, a challenge that even human radiologists struggle with. This suggests AI can offer an edge in identifying subtle or atypical presentations.
  • Potential for Pandemic Control: The research positions the AI model not just as a diagnostic aid but as a tool that can help control disease transmission by enabling faster, more accessible diagnoses, especially in resource-limited settings.

Key Results

The AI model demonstrated strong performance in classifying COVID-19, CAP, and normal cases:

Using CT Scans Only: * COVID-19 Sensitivity: 89.5% ± 0.11 * CAP Sensitivity: 95% ± 0.11 * Normal Sensitivity (Specificity): 85.7% ± 0.16 * Accuracy: 90% ± 0.06

Incorporating Clinical Data: * COVID-19 Sensitivity: 94.3% ± 0.05 * CAP Sensitivity: 96.7% ± 0.07 * Normal Sensitivity (Specificity): 91% ± 0.09 * Accuracy: 94.1% ± 0.03

The AI model's performance was comparable to, and in some metrics, slightly better than, a fourth experienced radiologist who was blinded to the ground truth. For instance, when using both CT and clinical data, the AI achieved a higher CAP sensitivity (96.7% vs. 93.3%) and accuracy (94.1% vs. 95.4% for the radiologist, though the difference was not statistically significant).

Limitations and Future Work

The authors acknowledge several limitations:

  • Single-Center Dataset: The primary dataset was collected from a single center, raising concerns about generalizability to diverse populations and external institutes. Future work should involve multi-center validation.
  • CAP Dataset Origin: The CAP cases were sourced from a different cohort and acquired using standard-dose CT, which might introduce a bias as low-dose screening generally has lower detection capabilities.
  • Small Sample Size: While capsule networks are robust with smaller datasets, larger multi-center datasets are still desired to further improve performance.
  • Domain Validation: The study did not account for different COVID-19 variants, which could impact diagnostic performance. Future work should explore domain validation across variants.
  • Explainability: While Grad-CAM visualizations show the model focuses on relevant image regions, further research is needed to enhance the model's explainability.
  • Performance on Cases Without Imaging Findings: The model showed limited success in detecting COVID-19 cases that lacked clear imaging findings, an area for future improvement.

Future work will focus on expanding the AI model to predict disease severity, improving explainability, and testing the model in real-world clinical settings as a decision support tool alongside thoracic radiologists, rather than as a standalone diagnostic system.

Summary updated

Abstract

Reverse transcription-polymerase chain reaction (RT-PCR) is currently the gold standard in COVID-19 diagnosis. It can, however, take days to provide the diagnosis, and false negative rate is relatively high. Imaging, in particular chest computed tomography (CT), can assist with diagnosis and assessment of this disease. Nevertheless, it is shown that standard dose CT scan gives significant radiation burden to patients, especially those in need of multiple scans. In this study, we consider low-dose and ultra-low-dose (LDCT and ULDCT) scan protocols that reduce the radiation exposure close to that of a single X-Ray, while maintaining an acceptable resolution for diagnosis purposes. Since thoracic radiology expertise may not be widely available during the pandemic, we develop an Artificial Intelligence (AI)-based framework using a collected dataset of LDCT/ULDCT scans, to study the hypothesis that the AI model can provide human-level performance. The AI model uses a two stage capsule network architecture and can rapidly classify COVID-19, community acquired pneumonia (CAP), and normal cases, using LDCT/ULDCT scans. The AI model achieves COVID-19 sensitivity of 89.5% +\- 0.11, CAP sensitivity of 95% +\- 0.11, normal cases sensitivity (specificity) of 85.7% +\- 0.16, and accuracy of 90% +\- 0.06. By incorporating clinical data (demographic and symptoms), the performance further improves to COVID-19 sensitivity of 94.3% +\- pm 0.05, CAP sensitivity of 96.7% +\- 0.07, normal cases sensitivity (specificity) of 91% +\- 0.09 , and accuracy of 94.1% +\- 0.03. The proposed AI model achieves human-level diagnosis based on the LDCT/ULDCT scans with reduced radiation exposure. We believe that the proposed AI model has the potential to assist the radiologists to accurately and promptly diagnose COVID-19 infection and help control the transmission chain during the pandemic.
BibTeX
@misc{afshar2021human,
  author = {Parnian Afshar and Moezedin Javad Rafiee and Farnoosh Naderkhani and Shahin Heidarian and Nastaran Enshaei and Anastasia Oikonomou and Faranak Babaki Fard and Reut Anconina and Keyvan Farahani and Konstantinos N. Plataniotis and Arash Mohammadi},
  title = {{Human-level COVID-19 Diagnosis from Low-dose CT Scans Using a Two-stage Time-distributed Capsule Network}},
  year = {2021},
  eprint = {2105.14656},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2105.14656},
}
Figure