COVID-Rate: An Automated Framework for Segmentation of COVID-19 Lesions from Chest CT Scans

Nastaran Enshaei, Anastasia Oikonomou, Moezedin Javad Rafiee, Parnian Afshar, Shahin Heidarian, Arash Mohammadi, Konstantinos N. Plataniotis, Farnoosh NaderkhaniarXiv 2021 · OpenReview

TL;DR

This paper introduces COVID-Rate, a novel deep learning framework for automatically segmenting COVID-19 lung lesions from CT scans. To address the scarcity of annotated data, they also release a new COVID-19 CT segmentation dataset and a synthetic data generation pipeline, achieving state-of-the-art performance in lesion segmentation.

What Problem Does This Paper Address?

The COVID-19 pandemic has placed an immense strain on healthcare systems, making accurate and efficient assessment of lung involvement crucial for patient management and resource allocation. Chest CT scans are a valuable tool for this, but manual analysis by radiologists is time-consuming, expensive, and prone to errors, especially with the increasing number of cases and emerging variants. Existing automated methods often struggle with limited annotated data and generalizing across different scanners. This paper aims to bridge this gap by developing an automated, accurate, and robust framework for segmenting COVID-19 lung abnormalities.

Methods

The core of the proposed solution is the COVID-Rate framework, a deep convolutional neural network (CNN) with an encoder-decoder architecture. Key innovations include:

  • Modified Encoder: Instead of traditional max-pooling, a convolution layer with stride 2 is used for down-sampling to minimize information loss. Residual links are incorporated to aid gradient flow and learning deeper features.
  • Context Perception Boosting (CPB) Module: This module is integrated into the encoder to capture multi-scale representations of COVID-19 manifestations. It uses parallel dilated convolutions with different dilation rates (1, 2, 4, 8) to increase the receptive field and better detect lesions of varying sizes and distributions.
  • Hybrid Loss Function: To handle the class imbalance common in medical imaging (few lesion pixels vs. many background pixels), a hybrid loss combining weighted Binary Cross-Entropy (w-BCE) and Focal Tversky Loss (FTL) is employed. This prioritizes correctly classifying difficult-to-segment pixels and helps balance the trade-off between false positives and false negatives.
  • Synthetic Data Generation: To augment the limited annotated data, a novel pipeline is introduced. This pipeline extracts COVID-19 infection regions from infected CT scans and inserts them into healthy CT scans, creating synthetic image-mask pairs. This aims to increase data variability and improve model generalization.

Datasets

The paper utilizes and introduces several datasets:

  • Dataset A: A public dataset containing chest CT volumes from 10 COVID-19 patients, with 2,581 slices, 1,351 of which are annotated for COVID-19 manifestations.
  • Dataset B (COVID-CT-Rate): A newly introduced, open-access dataset created by the authors. It comprises 433 annotated CT images from 82 COVID-19 patients, with expert radiologist annotations for Ground-Glass Opacity (GGO) and consolidation.
  • Dataset C: A dataset containing nine COVID-19 chest CT volumes (829 slices total), with 373 annotated slices. This dataset is used for generalization assessment.
  • Dataset D: An in-house dataset used in previous work, containing CT volumes from healthy cases, COVID-19 patients, and other pneumonia types. A subset of COVID-19 cases from this dataset is used.

Key Insights and Ideas

  • The importance of multi-scale context: The CPB module's success highlights that COVID-19 lesions can vary significantly in size and distribution, requiring a model that can perceive context at multiple scales.
  • Hybrid loss for imbalanced data: Simply using standard loss functions can lead to poor sensitivity for the minority class (lesions). The hybrid loss effectively balances the need to detect lesions while maintaining high overall accuracy.
  • Synthetic data generation as a powerful tool: The proposed augmentation method significantly improves performance, demonstrating that generating realistic synthetic data can be a viable strategy to overcome data scarcity in medical imaging.
  • Generalization to unseen scanners is achievable: The model shows promising results on external datasets acquired from different scanners, suggesting its potential for real-world clinical deployment.

Key Results

The COVID-Rate framework achieved state-of-the-art performance:

  • Overall Performance: On a combined dataset (A+B) with 10-fold cross-validation, the model achieved a Dice Similarity Coefficient (DSC) of 0.8019 ± 0.032, Specificity (SPC) of 0.9969 ± 0.0008, Sensitivity (SEN) of 0.8323 ± 0.046, and Mean Absolute Error (MAE) of 0.0052 ± 0.001.
  • Lesion Size Performance: The model performed better on larger infection regions (Group B, DSC: 0.8254) but still showed acceptable performance on smaller regions (Group A, DSC: 0.6748).
  • Generalization: On an external dataset (Dataset C), the model achieved a DSC of 0.797, SPC of 0.9933, SEN of 0.898, and MAE of 0.0085 for CT images with infection regions.
  • Whole Lung Volume Segmentation: The model demonstrated promising results in segmenting lesions across whole lung volumes, achieving a DSC of 0.79 and SEN of 0.893.
  • Synthetic Data Impact: Using the proposed synthetic data augmentation improved the average DSC from 0.7599 to 0.781 and average SEN from 0.8104 to 0.8308.

Limitations and Future Work

  • Limitations:
    • While the model performs well on different scales, its performance on very small infection regions is lower than on larger ones.
  • The paper acknowledges that fully supervised learning with accurate labels is still superior to weakly supervised or synthetic data approaches, though the latter are crucial for overcoming data limitations.
  • Future Work:
    • Extend COVID-Rate for quantifying specific COVID-19 severity measures.
  • Integrate the framework into a hybrid deep learning model to predict high-risk patients and adverse outcomes.
  • Further explore and refine data augmentation techniques.

Summary updated

Abstract

Novel Coronavirus disease (COVID-19) is a highly contagious respiratory infection that has had devastating effects on the world. Recently, new COVID-19 variants are emerging making the situation more challenging and threatening. Evaluation and quantification of COVID-19 lung abnormalities based on chest Computed Tomography (CT) scans can help determining the disease stage, efficiently allocating limited healthcare resources, and making informed treatment decisions. During pandemic era, however, visual assessment and quantification of COVID-19 lung lesions by expert radiologists become expensive and prone to error, which raises an urgent quest to develop practical autonomous solutions. In this context, first, the paper introduces an open access COVID-19 CT segmentation dataset containing 433 CT images from 82 patients that have been annotated by an expert radiologist. Second, a Deep Neural Network (DNN)-based framework is proposed, referred to as the COVID-Rate, that autonomously segments lung abnormalities associated with COVID-19 from chest CT scans. Performance of the proposed COVID-Rate framework is evaluated through several experiments based on the introduced and external datasets. The results show a dice score of 0:802 and specificity and sensitivity of 0:997 and 0:832, respectively. Furthermore, the results indicate that the COVID-Rate model can efficiently segment COVID-19 lesions in both 2D CT images and whole lung volumes. Results on the external dataset illustrate generalization capabilities of the COVID-Rate model to CT images obtained from a different scanner.
BibTeX
@misc{enshaei2021covid,
  author = {Nastaran Enshaei and Anastasia Oikonomou and Moezedin Javad Rafiee and Parnian Afshar and Shahin Heidarian and Arash Mohammadi and Konstantinos N. Plataniotis and Farnoosh Naderkhani},
  title = {{COVID-Rate: An Automated Framework for Segmentation of COVID-19 Lesions from Chest CT Scans}},
  year = {2021},
  eprint = {2107.01527},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2107.01527},
}
Figure