Classification of COVID-19 Chest CT Images Based on Ensemble Deep Learning

Xiaoshuo Li, Wenjun Tan, Pan Liu, Qinghua Zhou, Jinzhu YangJournal of Healthcare Engineering 2021 · DOI

TL;DR

This paper introduces an ensemble deep learning approach, combining VGG16 with stacked generalization, to improve the accuracy of classifying COVID-19, common pneumonia, and normal chest CT scans. The method achieves a high accuracy of 93.57%, outperforming a single VGG16 model and offering a promising tool for faster and more efficient COVID-19 diagnosis.

What Problem Does This Paper Address?

The COVID-19 pandemic highlighted the urgent need for rapid and accurate diagnostic tools. While RT-PCR is the gold standard, it faces challenges like long waiting times, false negatives, and reagent shortages. Chest CT imaging has emerged as a crucial adjunctive diagnostic tool, showing characteristic patterns in COVID-19 patients. However, manual CT analysis can be time-consuming and requires expert radiologists. Existing deep learning models for CT classification, while promising, often struggle with accuracy, training time, and dataset limitations, especially for multi-class classification tasks involving COVID-19, common pneumonia, and normal cases. This paper aims to address these limitations by developing a more robust and accurate automated classification system.

Methods

The core of this work is an ensemble deep learning strategy. The authors leverage the VGG16 architecture, a well-established deep convolutional neural network, as their base model. To enhance its performance, they employ stacked generalization, a technique where multiple models are trained on different subsets of the data, and their outputs are then used as inputs for a meta-classifier.

Specifically, the training dataset is divided into several disjoint subsets. On these subsets, they train multiple binary classifiers (e.g., COVID-19 vs. common pneumonia) and a single triclassifier (COVID-19, common pneumonia, normal) using the VGG16 model. The "deviant information" or generalization behavior from these individual classifiers is then fed into a cascade classifier (formed through stacked generalization) to produce the final prediction. This ensemble approach aims to mitigate the weaknesses of individual models and improve overall classification robustness.

Datasets

The study utilized a dataset comprising CT images from 1417 patients. The training set consisted of images from 328 patients: 115 with COVID-19, 128 with common pneumonia, and 85 normal controls. The performance evaluation was conducted on a larger test set of 139,852 slices from 1,089 patients, including 76,000 slices from 675 COVID-19 patients, 18,852 slices from 256 common pneumonia patients, and 45,000 slices from 158 normal controls. This dataset was sourced from the China Consortium for Chest CT Image Survey (CC-CCI).

Key Insights and Ideas

  • Ensemble learning significantly boosts performance: The combination of VGG16 with stacked generalization demonstrably improved classification metrics compared to using VGG16 alone. This highlights the power of ensemble methods in overcoming individual model limitations.
  • Targeting high-error classes is crucial: The authors identified specific misclassification patterns (e.g., normal control misclassified as common pneumonia) and addressed them by training specialized binary classifiers on subsets that focused on these challenging distinctions. This targeted approach proved effective in reducing error rates.
  • Stacked generalization effectively captures diverse information: By training classifiers on different data subsets and feeding their outputs into a meta-classifier, the ensemble method can capture a wider range of features and nuances present in the data, leading to more accurate predictions.

Key Results

The proposed ensemble deep learning model achieved impressive results:

  • Overall Accuracy: 93.57%
  • Sensitivity (Recall): 94.21%
  • Specificity: 93.93%
  • Precision: 89.40%
  • F1-score: 91.74%

These metrics represent a significant improvement over a single VGG16 triclassifier, which achieved an accuracy of 88.12%. The ensemble model showed improvements across all evaluated metrics, with accuracy increasing by 5.45% and F1-score by 5.2%.

Limitations and Future Work

The authors acknowledge several limitations:

  • 2D Image Limitation: The study exclusively used 2D CT images, neglecting the rich spatial information available in 3D CT scans.
  • Model Specificity: Only the VGG16 model was explored, and the potential benefits of newer network architectures were not investigated.
  • Dataset Format: The publicly available dataset used was not in the original DICOM format, leading to potential loss of pixel information during format conversion.

Future work could involve incorporating 3D CNNs, exploring other advanced deep learning architectures, and utilizing original DICOM data to further enhance performance.

Summary updated

Abstract

Novel coronavirus pneumonia (NCP) has become a global pandemic disease, and computed tomography-based (CT) image analysis and recognition are one of the important tools for clinical diagnosis. In order to assist medical personnel to achieve an efficient and fast diagnosis of patients with new coronavirus pneumonia, this paper proposes an assisted diagnosis algorithm based on ensemble deep learning. The method combines the Stacked Generalization ensemble learning with the VGG16 deep learning to form a cascade classifier, and the information constituting the cascade classifier comes from multiple subsets of the training set, each of which is used to collect deviant information about the generalization behavior of the data set, such that this deviant information fills the cascade classifier. The algorithm was experimentally validated for classifying patients with novel coronavirus pneumonia, patients with common pneumonia (CP), and normal controls, and the algorithm achieved a prediction accuracy of 93.57%, sensitivity of 94.21%, specificity of 93.93%, precision of 89.40%, and F1-score of 91.74% for the three categories. The results show that the method proposed in this paper has good classification performance and can significantly improve the performance of deep neural networks for multicategory prediction tasks.
BibTeX
@article{li2021classification,
  author = {Xiaoshuo Li and Wenjun Tan and Pan Liu and Qinghua Zhou and Jinzhu Yang},
  title = {{Classification of COVID-19 Chest CT Images Based on Ensemble Deep Learning}},
  journal = {Journal of Healthcare Engineering},
  year = {2021},
  doi = {10.1155/2021/5528441},
}
Figure