Automatic COVID-19 and Common-Acquired Pneumonia Diagnosis Using Chest CT Scans

Pedro Crosara Motta, Paulo César Cortez, Bruno Riccelli dos Santos Silva, Guang Yang, Victor Hugo C. de AlbuquerqueBioengineering 2023 · DOI

TL;DR

This paper presents an automated pipeline for diagnosing COVID-19 and Common-Acquired Pneumonia (CAP) from chest CT scans. By combining advanced deep learning models for segmentation and classification, the system can accurately identify lung and lesion abnormalities, differentiate between COVID-19 and CAP, and even quantify disease severity, offering a valuable tool for clinical decision support, especially in resource-limited settings.

What Problem Does This Paper Address?

The ongoing COVID-19 pandemic, despite vaccination efforts, continues to pose a significant threat, necessitating rapid and accurate diagnostic tools. Chest CT scans are crucial for identifying pneumonia, a common symptom of COVID-19, but distinguishing it from other forms of pneumonia like CAP can be challenging. Furthermore, assessing the severity of COVID-19 is vital for appropriate patient management, particularly in intensive care units. Existing Computer-Aided Diagnostic (CAD) systems often focus on individual tasks like segmentation or classification, or lack robust external validation. This paper aims to bridge this gap by developing a comprehensive, end-to-end pipeline that not only detects and segments lung and lesion abnormalities but also classifies them as COVID-19 or CAP, and quantifies COVID-19 severity, all while ensuring generalizability through external validation.

Methods

The authors developed a multi-stage deep learning pipeline. The first stage involves lung and lesion segmentation using various encoder-decoder architectures (e.g., ResNeXt101-Unet++, MobilenetV2-Unet). They explored 16 combinations of state-of-the-art encoders and decoders, optimizing hyperparameters through grid search to achieve high F1-scores for lesion segmentation.

The second stage is classification, where CNN models (e.g., Densenet201) are trained to differentiate between COVID-19 and CAP based on the segmented lesions. This stage addresses the challenge that segmentation models alone may not distinguish between the two diseases.

Finally, for confirmed COVID-19 cases, the pipeline quantifies lesion severity by calculating the percentage of parenchymal involvement. This provides a quantitative measure that can aid in assessing disease progression. A key aspect of their methodology is the emphasis on external validation using the SPGC dataset to ensure the model's robustness and generalizability beyond the training data distribution.

Datasets

The study utilized several publicly available datasets:

  • Lung Segmentation: Coronacases, Kaggle, Medical Segmentation (totaling 3677 images).
  • Lesion Segmentation: Coronacases, Kaggle, Medical Segmentation, and others (totaling 6493 images).
  • Classification: COVIDxCT dataset (a large dataset with COVID-19 and CAP cases).
  • Severity Quantification & External Validation: MosMedData (for severity assessment and internal validation) and SPGC dataset (for external validation).

The SPGC dataset is particularly noteworthy as it includes CAP exams and represents a different distribution than the training data, crucial for assessing real-world performance.

Key Insights and Ideas

  • End-to-End Pipeline: The paper demonstrates the feasibility and effectiveness of a complete pipeline that integrates segmentation, classification, and severity assessment, moving beyond single-task models.
  • External Validation is Crucial: The performance drop on the SPGC dataset highlights the importance of external validation to understand how models generalize to unseen data distributions, a common challenge in medical imaging AI.
  • 2D Slices Suffice for Classification: The study explores and validates the use of single CT slices for classification, significantly reducing processing time compared to full 3D analysis, which is vital for rapid diagnosis.
  • Quantitative Severity Assessment: Moving from qualitative to quantitative severity assessment for COVID-19 provides more objective data for clinical decision-making.

Key Results

  • Lung Segmentation: Achieved high accuracy (up to 99.71%) and F1-scores (up to 98.64%) with minimal differences between architectures. ResNeXt101-Unet++ showed slightly superior performance.
  • Lesion Segmentation: Demonstrated excellent results with accuracy around 99.85% and F1-scores around 85.16% (Densenet201-Unet++).
  • External Lesion Detection (SPGC): MobilenetV2-Unet achieved the highest accuracy (98.05%) and F1-score (98.70%) in external validation, processing full CT scans in just 19.70 seconds.
  • COVID-19 vs. CAP Classification: ResNeXt101 achieved the highest performance on the COVIDxCT dataset (accuracy 96.79%, F1-score 96.84%). However, external validation on SPGC showed some misclassifications between COVID-19 and CAP, with Densenet201 achieving 90.47% accuracy and 93.85% F1-score, but a lower specificity of 65.07%.
  • COVID-19 Severity: MobilenetV2-Unet showed the highest accuracy (75.05%) and F1-score (73.26%) in severity assessment on MosMedData.

Limitations and Future Work

  • Cost and Radiation: The high cost and radiation exposure of CT scans limit data availability and widespread adoption, impacting model training and real-world deployment.
  • 2D vs. 3D Analysis: The study primarily uses 2D slices, which simplifies computation but may miss crucial 3D information present in CT scans, potentially affecting diagnostic accuracy.
  • Limited Clinical Context: CT scans alone are insufficient for a complete diagnosis; integrating clinical data (symptoms, medical history) processed via Natural Language Processing (NLP) could significantly improve diagnostic accuracy.
  • Inter-Disease Overlap: Differentiating COVID-19 from other respiratory diseases remains challenging due to overlapping imaging features.
  • Future Work: The authors suggest exploring 3D segmentation and classification architectures, integrating clinical data with NLP, and increasing monitored data to enhance diagnostic accuracy and differentiate between diseases more effectively. They also propose evaluating the trade-off between processing time and accuracy for different models.

Summary updated

Abstract

Even with over 80% of the population being vaccinated against COVID-19, the disease continues to claim victims. Therefore, it is crucial to have a secure Computer-Aided Diagnostic system that can assist in identifying COVID-19 and determining the necessary level of care. This is especially important in the Intensive Care Unit to monitor disease progression or regression in the fight against this epidemic. To accomplish this, we merged public datasets from the literature to train lung and lesion segmentation models with five different distributions. We then trained eight CNN models for COVID-19 and Common-Acquired Pneumonia classification. If the examination was classified as COVID-19, we quantified the lesions and assessed the severity of the full CT scan. To validate the system, we used Resnetxt101 Unet++ and Mobilenet Unet for lung and lesion segmentation, respectively, achieving accuracy of 98.05%, F1-score of 98.70%, precision of 98.7%, recall of 98.7%, and specificity of 96.05%. This was accomplished in just 19.70 s per full CT scan, with external validation on the SPGC dataset. Finally, when classifying these detected lesions, we used Densenet201 and achieved accuracy of 90.47%, F1-score of 93.85%, precision of 88.42%, recall of 100.0%, and specificity of 65.07%. The results demonstrate that our pipeline can correctly detect and segment lesions due to COVID-19 and Common-Acquired Pneumonia in CT scans. It can differentiate these two classes from normal exams, indicating that our system is efficient and effective in identifying the disease and assessing the severity of the condition.
BibTeX
@inproceedings{motta2023automatic,
  author = {Pedro Crosara Motta and Paulo César Cortez and Bruno Riccelli dos Santos Silva and Guang Yang and Victor Hugo C. de Albuquerque},
  title = {{Automatic COVID-19 and Common-Acquired Pneumonia Diagnosis Using Chest CT Scans}},
  booktitle = {Bioengineering},
  year = {2023},
  doi = {10.3390/bioengineering10050529},
}
Figure