Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images

Tae Joon Jun, Dohyeun Kim, Daeyoung KimarXiv 2018 · OpenReview

TL;DR

This paper introduces an ensemble of Convolutional Neural Networks (CNNs) that leverage multi-sized chest radiography images to improve the automated diagnosis of pneumothorax. By combining predictions from models trained on different image resolutions, they achieve a state-of-the-art AUC of 0.911, outperforming previous methods and offering a promising approach for large medical image analysis.

What Problem Does This Paper Address?

Pneumothorax, a condition where air leaks into the space between the lung and chest wall, can be challenging to detect even with chest X-rays. While experienced radiologists can often identify it, subtle cases can be missed. This paper aims to address the need for a reliable automated system to assist physicians in diagnosing pneumothorax from chest radiography images, serving as a crucial pre-screening step before more detailed imaging like CT scans. Existing automated methods often struggle with resizing large medical images, leading to the loss of critical features.

Methods

The core of this work is an ensemble learning approach using identical 50-layer ResNet models. The key innovation lies in feeding these models with chest radiography images resized to three different dimensions: 512x512, 384x384, and 256x256 pixels. The rationale is that different image sizes capture varying levels of detail; smaller images might highlight specific features, while larger ones retain more general information. By averaging the softmax outputs of these three models, the ensemble aims to leverage the strengths of each resolution, mitigating the feature loss that can occur when images are uniformly resized to a single, smaller dimension. The ResNet models themselves are pre-trained on ImageNet and then fine-tuned on the chest X-ray dataset.

Datasets

The primary dataset used for training and evaluation is the ChestX-ray8 dataset. This dataset is substantial, containing over 100,000 chest radiography images with multiple labels for various thoracic diseases, including pneumothorax. The authors specifically utilized 59,156 normal images and 5,225 pneumothorax images, totaling 64,381 images for their experiments. They divided this dataset into an 80:20 ratio for training and testing, with a further 20% of the training set allocated for validation.

Key Insights and Ideas

  • Multi-sizing is key: The paper strongly suggests that using multiple image resolutions for training CNNs is more effective than relying on a single size, especially for large medical images. This approach helps preserve lost features that might be discarded during aggressive downsampling.
  • Ensemble power: Combining the predictions of multiple models, even identical ones trained on different data views (in this case, different image sizes), leads to improved robustness and performance. The ensemble's AUC of 0.911 is a testament to this.
  • ResNet's suitability: The choice of a 50-layer ResNet architecture, fine-tuned for the task, proves effective. The authors highlight that for large datasets like ChestX-ray8, simply training the top layers of a pre-trained model (transfer learning) is insufficient; deeper fine-tuning is necessary.
  • Trade-offs in medical data: The paper touches upon the inherent trade-off between specificity and sensitivity in medical diagnosis, particularly with imbalanced datasets. They address this by selecting a cut-off point on the ROC curve that maximizes the sum of specificity and sensitivity, effectively maximizing accuracy.

Key Results

The proposed ensemble model achieved a state-of-the-art Area Under the Receiver Operating Characteristic Curve (AUC) of 0.911 for pneumothorax detection. This represents a significant improvement over previous studies, with an increase of 0.023 AUC compared to the best prior result (0.888 AUC by Rajpurkar et al.). The ensemble model also showed a 1.3% performance improvement in accuracy compared to the average performance of individual models (0.894 AUC).

Limitations and Future Work

Limitations: * The paper does not explicitly detail the computational cost or inference time of the ensemble model, which could be a factor in real-world clinical deployment. * While the ChestX-ray8 dataset is large, it's a specific benchmark. The generalizability to other datasets or variations in X-ray equipment might not be fully explored.

Future Work: The authors plan to develop a service that assists physicians in diagnosing pneumothorax using their proposed CNN classifier. This indicates a clear path towards clinical translation and application of their research.

Summary updated

Abstract

Pneumothorax is a relatively common disease, but in some cases, it may be difficult to find with chest radiography. In this paper, we propose a novel method of detecting pneumothorax in chest radiography. We propose an ensemble model of identical convolutional neural networks (CNN) with three different sizes of radiography images. Conventional methods may not properly characterize lost features while resizing large size images into 256 x 256 or 224 x 224 sizes. Our model is evaluated with ChestX-ray dataset which contains over 100,000 chest radiography images. As a result of the experiment, the proposed model showed AUC 0.911, which is the state of the art result in pneumothorax detection. Our method is expected to be effective when applying CNN to large size medical images.
BibTeX
@misc{jun2018automated,
  author = {Tae Joon Jun and Dohyeun Kim and Daeyoung Kim},
  title = {{Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images}},
  year = {2018},
  eprint = {1804.06821},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1804.06821},
}
Figure