Do Lateral Views Help Automated Chest X-ray Predictions?

Hadrien Bertrand, Mohammad Hashir, Joseph Paul CohenarXiv 2019 · OpenReview

TL;DR

This paper investigates whether adding lateral views to standard frontal (PA) chest X-rays improves the accuracy of automated disease detection. They found that lateral views offer a performance boost for a subset of conditions, but combining both views didn't yield straightforward improvements, suggesting a need for more sophisticated fusion techniques.

What Problem Does This Paper Address?

Automated systems for analyzing chest X-rays predominantly rely on the posteroanterior (PA) view, largely because it's the most commonly available view in public datasets. However, the lateral view, while less frequently used in automated systems due to its perceived difficulty and infrequent availability, is known to provide crucial diagnostic information that might be obscured in the PA view (e.g., by the heart or diaphragm). This paper addresses the question of whether incorporating lateral views can genuinely enhance the diagnostic capabilities of AI models for a variety of chest conditions.

Methods

The researchers employed a standard DenseNet architecture, a type of convolutional neural network known for its dense connectivity between layers. They trained two separate models: one exclusively on PA views and another exclusively on lateral views. The models were trained using a binary cross-entropy loss function, with class weights adjusted to account for label imbalance. For evaluation, they focused on the Area Under the Receiver Operating Characteristic Curve (AUC) as the primary metric.

Datasets

The primary dataset used in this study is PadChest (Bustos et al., 2019). This dataset is a large-scale public chest X-ray collection that includes paired PA and lateral views, along with annotated radiological findings and differential diagnoses. The authors filtered the dataset to include only single visits from patients with both PA and lateral views, resulting in approximately 30,699 patients. They also mention the potential for validating their findings on other datasets like MIMIC-CXR and CheXpert in future work.

Key Insights and Ideas

  • Lateral Views Offer Specific Diagnostic Value: The study confirms that lateral views are not redundant and can provide unique diagnostic information for certain conditions, leading to improved model performance.
  • Not All Conditions Benefit Equally: The benefit of lateral views is condition-specific. While some conditions see a significant improvement, others are equally well-handled by PA views alone.
  • Simple Fusion is Not Enough: Merely combining PA and lateral views (e.g., by stacking them as input channels) does not automatically lead to better performance. This highlights the complexity of multi-view fusion in medical imaging.
  • Data Quality Matters: The authors acknowledge that the PadChest dataset, while valuable, has limitations, including labels derived from RNNs and potential biases due to its single-hospital origin.

Key Results

  • For 8 out of 56 evaluated labels, the model trained on lateral views achieved a better AUC than the model trained on PA views.
  • For 21 labels, both PA and lateral views resulted in similar performance.
  • For the remaining 26 labels, the PA view was more informative.
  • The average weighted AUC across all labels was 0.79, which the authors consider encouraging given the simplicity of the model and the subset of data used.
  • Attempts to combine PA and lateral views jointly did not consistently lead to performance increases and showed high variance across different labels and random seeds.

Limitations and Future Work

The authors acknowledge several limitations:

  • Label Reliability: A significant portion of the labels in the PadChest dataset were extracted by an RNN, which may introduce inaccuracies.
  • Dataset Bias: The dataset originates from a single hospital, potentially limiting the generalizability of the findings.
  • Multi-View Fusion Complexity: The study found that simple methods for combining PA and lateral views were not effective.

Future work suggested includes:

  • More Sophisticated Fusion Techniques: Investigating advanced methods for integrating information from multiple views, such as dedicated multi-view fusion architectures.
  • Validation on Diverse Datasets: Replicating these findings on other large-scale datasets like MIMIC-CXR and CheXpert to assess generalizability.
  • Further Investigation into Specific Conditions: Deeper analysis into why lateral views are beneficial for certain conditions and how to best leverage this information.

Summary updated

Abstract

Most convolutional neural networks in chest radiology use only the frontal posteroanterior (PA) view to make a prediction. However the lateral view is known to help the diagnosis of certain diseases and conditions. The recently released PadChest dataset contains paired PA and lateral views, allowing us to study for which diseases and conditions the performance of a neural network improves when provided a lateral x-ray view as opposed to a frontal posteroanterior (PA) view. Using a simple DenseNet model, we find that using the lateral view increases the AUC of 8 of the 56 labels in our data and achieves the same performance as the PA view for 21 of the labels. We find that using the PA and lateral views jointly doesn't trivially lead to an increase in performance but suggest further investigation.
BibTeX
@misc{bertrand2019do,
  author = {Hadrien Bertrand and Mohammad Hashir and Joseph Paul Cohen},
  title = {{Do Lateral Views Help Automated Chest X-ray Predictions?}},
  year = {2019},
  eprint = {1904.08534},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1904.08534},
}
Figure