COVID-CT-MD: COVID-19 Computed Tomography (CT) Scan Dataset Applicable in Machine Learning and Deep Learning

Parnian Afshar, Shahin Heidarian, Nastaran Enshaei, Farnoosh Naderkhani, Moezedin Javad Rafiee, Anastasia Oikonomou, Faranak Babaki Fard, Kaveh Samimi, Konstantinos N. Plataniotis, Arash MohammadiarXiv 2020 · OpenReview

TL;DR

This paper introduces COVID-CT-MD, a comprehensive dataset of CT scans for COVID-19, Community Acquired Pneumonia (CAP), and healthy individuals. This dataset, featuring detailed patient-level, slice-level, and lobe-level annotations, aims to accelerate the development of advanced machine learning models for COVID-19 diagnosis and analysis.

What Problem Does This Paper Address?

The COVID-19 pandemic has placed an immense strain on global healthcare systems, highlighting the critical need for rapid and accurate diagnostic tools. While RT-PCR is the gold standard, it's time-consuming and can have low sensitivity. Chest X-rays (CXRs) are faster but less sensitive than Computed Tomography (CT) scans, which offer high sensitivity and are crucial for detecting complications. However, existing publicly available CT datasets for COVID-19 are often limited in size, lack comparative data from other respiratory diseases, and suffer from insufficient or inconsistent labeling. This scarcity hinders the development and validation of robust AI models for COVID-19 detection and analysis.

Methods

The paper focuses on introducing and describing the COVID-CT-MD dataset. The data collection involved de-identifying CT scans from patients with confirmed COVID-19, CAP, and healthy controls. A key aspect of their methodology is the detailed annotation process. Three experienced radiologists meticulously labeled the CT scans at multiple granularities:

  • Patient-level: A single diagnosis for the entire subject.
  • Slice-level: Identification of individual CT slices showing signs of infection.
  • Lobe-level: Pinpointing which specific lung lobes exhibit infection.

This multi-level labeling is a significant contribution, enabling more nuanced analysis and model development. The paper also details the CT acquisition settings, ensuring a degree of standardization and providing information crucial for understanding potential biases or variations in the data.

Datasets

The primary contribution of this paper is the introduction of the COVID-CT-MD dataset. This dataset comprises:

  • 171 confirmed COVID-19 cases.
  • 60 Community Acquired Pneumonia (CAP) cases.
  • 76 normal (healthy) cases.

The dataset is unique in its inclusion of CAP cases alongside COVID-19 and normal controls, facilitating comparative studies. Furthermore, it offers comprehensive labels at patient, slice, and lobe levels, which is a significant improvement over many existing datasets that may only provide patient-level labels or focus solely on infected slices. The data is organized into folders for each diagnosis, with subfolders for individual subjects and their corresponding DICOM CT slices. Accompanying CSV and NumPy files provide the detailed labeling information.

Key Insights and Ideas

  • Granular Labeling is Crucial: The paper strongly emphasizes the value of multi-level annotations (patient, slice, lobe). This granular information is essential for developing AI models that can not only diagnose COVID-19 but also pinpoint the location and extent of infection within the lungs, which is vital for treatment planning and prognosis.
  • Comparative Datasets Drive Better Models: Including CAP cases alongside COVID-19 and normal controls is a critical design choice. This allows researchers to train models that can better differentiate between various respiratory conditions, reducing the risk of misdiagnosis and improving the generalizability of AI solutions.
  • The Need for Standardized Data: The authors highlight the limitations of existing datasets due to varying imaging protocols. By detailing their acquisition settings, they provide a foundation for understanding and potentially harmonizing data from different sources.
  • AI's Role in Overwhelmed Healthcare: The paper frames the dataset's creation within the context of the pandemic's impact on healthcare workers. It positions AI as a vital tool to alleviate workload and improve diagnostic efficiency, especially when traditional methods are strained.

Key Results

The paper's main "result" is the creation and characterization of the COVID-CT-MD dataset. While it doesn't present a specific AI model's performance, it provides the foundation for such evaluations. Key statistics about the dataset include:

  • Total Cases: 307 (171 COVID-19, 60 CAP, 76 Normal).
  • Labeling Agreement: Radiologists showed high agreement (>90%) on diagnoses.
  • Infection Ratio: For labeled COVID-19 cases, the infection ratio (slices with infection / total slices) ranged from 7.0% to 86.2%. For CAP cases, it ranged from 7.8% to 56.8%.
  • Lobe Distribution: The average infection ratio was found to be higher in the lower lobes (LLL and RLL) for both COVID-19 and CAP cases compared to other lung regions.
  • Demographics: The dataset includes gender and age distributions, showing a slight male predominance in COVID-19 cases and varying age distributions across the diagnostic groups.

Limitations and Future Work

The authors acknowledge several limitations:

  • Focus on Distinct Manifestations: The slice and lobe labeling process prioritized regions with clear signs of infection, potentially overlooking subtle or minimal findings.
  • RT-PCR Limitations: Not all COVID-19 patients in the dataset had confirmed RT-PCR results due to accessibility issues during the pandemic's early stages in Iran. Some diagnoses relied on CT findings and clinical results.
  • Motion Artifacts: Due to dyspnea (difficulty breathing) in COVID-19 patients, some scans may contain mild motion artifacts, even after exclusion of low-quality scans.
  • Ambiguous Areas: Suspicious areas near the chest wall and diaphragm that were difficult to distinguish were not labeled as infected.

Future work, as implied by the dataset's design, would involve developing and evaluating machine learning and deep learning models for COVID-19 classification, segmentation, and potentially severity assessment using this rich dataset. The authors encourage researchers to utilize COVID-CT-MD to train and test their models and compare results.

Summary updated

Abstract

Novel Coronavirus (COVID-19) has drastically overwhelmed more than 200 countries affecting millions and claiming almost 1 million lives, since its emergence in late 2019. This highly contagious disease can easily spread, and if not controlled in a timely fashion, can rapidly incapacitate healthcare systems. The current standard diagnosis method, the Reverse Transcription Polymerase Chain Reaction (RT- PCR), is time consuming, and subject to low sensitivity. Chest Radiograph (CXR), the first imaging modality to be used, is readily available and gives immediate results. However, it has notoriously lower sensitivity than Computed Tomography (CT), which can be used efficiently to complement other diagnostic methods. This paper introduces a new COVID-19 CT scan dataset, referred to as COVID-CT-MD, consisting of not only COVID-19 cases, but also healthy and subjects infected by Community Acquired Pneumonia (CAP). COVID-CT-MD dataset, which is accompanied with lobe-level, slice-level and patient-level labels, has the potential to facilitate the COVID-19 research, in particular COVID-CT-MD can assist in development of advanced Machine Learning (ML) and Deep Neural Network (DNN) based solutions.
BibTeX
@misc{afshar2020covid,
  author = {Parnian Afshar and Shahin Heidarian and Nastaran Enshaei and Farnoosh Naderkhani and Moezedin Javad Rafiee and Anastasia Oikonomou and Faranak Babaki Fard and Kaveh Samimi and Konstantinos N. Plataniotis and Arash Mohammadi},
  title = {{COVID-CT-MD: COVID-19 Computed Tomography (CT) Scan Dataset Applicable in Machine Learning and Deep Learning}},
  year = {2020},
  eprint = {2009.14623},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2009.14623},
}
Figure