Nuances of Interpreting X-ray Analysis by Deep Learning and Lessons for Reporting Experimental Findings

Steinar Valsson, Ognjen ArandjelovićSci 2022 · DOI

TL;DR

This paper argues that relying solely on metrics like AUROC for evaluating deep learning models in X-ray analysis is insufficient, as it can mask significant differences in clinical utility. By performing a nuanced analysis of a state-of-the-art model on the ChestX-ray14 dataset, the authors demonstrate that models with similar AUROC scores can have vastly different real-world performance, highlighting the critical need for more comprehensive reporting and evaluation in this field.

What Problem Does This Paper Address?

The interpretation of medical images, particularly X-rays, is a complex task prone to human error. Deep learning (DL) offers a promising avenue for automating or assisting in this process. However, a significant challenge in current research is the evaluation of these DL models. Many studies rely on a single performance metric, most commonly the Area Under the Receiver Operating Characteristic Curve (AUROC). While AUROC provides a general measure of a classifier's ability to distinguish between classes, it often fails to capture the nuances of clinical applicability. This can lead to a misleading impression of model performance, where two models with similar AUROC scores might exhibit drastically different real-world usefulness, potentially leading to misdiagnoses and adverse patient outcomes. This paper aims to address this gap by advocating for a more thorough and clinically relevant evaluation of DL models in X-ray analysis.

Methods

The authors adopted a state-of-the-art deep learning approach, specifically a DenseNet-121 convolutional neural network, pre-trained on ImageNet and then re-trained on the ChestX-ray14 dataset. They implemented two model variations:

  • Standard Model: A baseline model trained solely on image data.
  • Modified Model: An enhanced model that incorporates patient metadata (gender and X-ray view position) in addition to image data.

For model interpretation and visualization, they employed Gradient-weighted Class Activation Mapping (Grad-CAM) to highlight the regions of the X-ray image that the model focuses on for its predictions. The evaluation involved a comprehensive analysis of various performance metrics beyond AUROC, including sensitivity, specificity, accuracy, and the diagnostic odds ratio (DOR). They also performed a quantitative assessment of the model's ability to localize diseases using the Intersection over Union (IoU) metric, comparing the model's heatmaps with ground-truth bounding boxes.

Datasets

The primary dataset used in this study is the ChestX-ray14 dataset. This dataset contains 108,000 labeled chest X-ray images from over 30,000 patients, with 14 different lung disease labels. The labels were automatically extracted from radiology reports using Natural Language Processing (NLP). For approximately 1000 images, bounding box annotations indicating the location of the disease were also available. The authors note that this dataset has been used in previous influential works.

Key Insights and Ideas

  • AUROC is a blunt instrument: The paper strongly emphasizes that AUROC, while widely used, can be a misleading metric. Two models with nearly identical AUROC scores can have significantly different clinical implications due to variations in their false positive/negative rates or localization capabilities.
  • Metadata can matter, but not always as expected: The modified model, which incorporated patient metadata, did not universally outperform the standard model across all metrics. This suggests that the benefit of metadata is context-dependent and requires careful integration.
  • Localization is crucial and often overlooked: The study highlights that accurate disease localization (where the model "looks" on the X-ray) is as important as accurate classification. The standard model, despite a slightly lower AUROC, demonstrated better localization performance in some cases.
  • Data quality and biases are pervasive: The authors discuss issues with the ChestX-ray14 dataset, such as potential confounding information (e.g., presence of a chest drain being mistaken for pneumothorax) and the impact of label frequency on model activations. This underscores the need for critical examination of the training data.
  • "Confounding information" can be a trap: The paper illustrates how external information not inherent to the disease itself (like textual descriptors on an image or medical devices) can be learned by the model, leading to high confidence predictions that are not clinically meaningful.

Key Results

  • AUROC comparison: The standard model achieved an AUROC of 0.800, while the modified model achieved a slightly higher 0.806. Per-label AUROCs showed minor differences, with neither model consistently outperforming the other.
  • Specificity and Sensitivity: The standard model showed superior specificity (0.741 vs. 0.720), meaning it generated fewer false positives. The modified model had higher sensitivity (0.751 vs. 0.726), indicating it detected more true positives.
  • Localization (IoU): The standard model generally outperformed the modified model in localizing disease presentations, with a higher average IoU (0.157 vs. 0.121). This was particularly notable for diseases like Cardiomegaly, where the modified model's localization was significantly worse.
  • Model Bias: The study revealed a bias towards the "Infiltration" class, which consistently received high activation scores even when it wasn't the true label, likely due to its high frequency in the dataset.

Limitations and Future Work

  • Limitations of the Dataset: The authors acknowledge criticisms of the ChestX-ray14 dataset, including potential issues with labelling accuracy, confounding information, and data balance. They specifically point out how the automatic extraction of labels can lead to models learning proxies for diseases rather than the diseases themselves.
  • Single Dataset Focus: While the ChestX-ray14 dataset is widely used, the findings might not generalize perfectly to other X-ray datasets or imaging modalities.
  • Need for Clinical Validation: The paper strongly advocates for more rigorous clinical validation of medical AI tools, moving beyond purely statistical metrics.
  • Future Work: The authors suggest further investigation into the hypothesis that more numerous classes exhibit greater variability in appearance, affecting IoU performance. They also call for explicit discussion of confounding factors in research and a thorough examination of data and specific findings when evaluating algorithms. The paper implicitly calls for the development of more sophisticated evaluation frameworks that capture clinical utility.

Summary updated

Abstract

With the increase in the availability of annotated X-ray image data, there has been an accompanying and consequent increase in research on machine-learning-based, and ion particular deep-learning-based, X-ray image analysis. A major problem with this body of work lies in how newly proposed algorithms are evaluated. Usually, comparative analysis is reduced to the presentation of a single metric, often the area under the receiver operating characteristic curve (AUROC), which does not provide much clinical value or insight and thus fails to communicate the applicability of proposed models. In the present paper, we address this limitation of previous work by presenting a thorough analysis of a state-of-the-art learning approach and hence illuminate various weaknesses of similar algorithms in the literature, which have not yet been fully acknowledged and appreciated. Our analysis was performed on the ChestX-ray14 dataset, which has 14 lung disease labels and metainfo such as patient age, gender, and the relative X-ray direction. We examined the diagnostic significance of different metrics used in the literature including those proposed by the International Medical Device Regulators Forum, and present the qualitative assessment of the spatial information learned by the model. We show that models that have very similar AUROCs can exhibit widely differing clinical applicability. As a result, our work demonstrates the importance of detailed reporting and analysis of the performance of machine-learning approaches in this field, which is crucial both for progress in the field and the adoption of such models in practice.
BibTeX
@inproceedings{valsson2022nuances,
  author = {Steinar Valsson and Ognjen Arandjelović},
  title = {{Nuances of Interpreting X-ray Analysis by Deep Learning and Lessons for Reporting Experimental Findings}},
  booktitle = {Sci},
  year = {2022},
  doi = {10.3390/sci4010003},
}
Figure