CXR-RefineDet: Single-Shot Refinement Neural Network for Chest X-Ray Radiograph Based on Multiple Lesions Detection

Cong Lin, Yongbin Zheng, Xiuchun Xiao, Jialun LinJournal of Healthcare Engineering 2022 · DOI

TL;DR

This paper introduces CXR-RefineDet, a novel single-shot object detection network designed for improved accuracy and speed in detecting multiple lesions in chest X-rays. By combining a new RRNet backbone with an "Information Reuse" module, it significantly enhances lesion detection performance compared to existing methods, making it more suitable for practical computer-aided diagnosis systems.

What Problem Does This Paper Address?

The increasing workload on radiologists, exacerbated by events like the COVID-19 pandemic, leads to a higher risk of misdiagnosis and missed diagnoses. While computer-aided diagnosis (CAD) systems show promise in assisting radiologists by localizing and identifying lesions in medical images, current deep learning-based object detection models often face challenges. These include high computational resource demands, slow inference speeds, and limitations in accurately detecting small or complex lesions, hindering their widespread adoption in clinical settings. This paper aims to address these limitations by developing a more efficient and accurate detection model specifically for chest X-ray (CXR) analysis.

Methods

The core of this work lies in two main innovations integrated into the RefineDet framework:

  • RRNet Backbone: The authors propose a new backbone network called RRNet. This backbone is designed to be parameter-efficient while maintaining strong feature extraction capabilities. It achieves this by combining the strengths of two existing architectural components:
  • RepVGG blocks: These blocks are used in the initial layers to enhance the extraction of low-level semantic features (like grayscale and texture) by parallelizing multiple convolutional operations within a single module.
  • Resblocks: These are employed in the deeper layers to facilitate the fusion of high-level semantic features across different network layers through residual connections. This combination aims to improve both single-layer and cross-layer feature extraction.
  • Information Reuse Structure: The authors observed that the features from the first two output layers of the original RefineDet network, after L2 normalization, were underutilized. To address this, they introduce an "Information Reuse" module. This module reconnects these normalized features back into the network. The rationale is that shallow features represent the deep features of an image, and reintroducing them can help the network better leverage scaling characteristics and improve overall detection capability.

These components are integrated into an improved RefineDet architecture, resulting in the proposed CXR-RefineDet model.

Datasets

The primary dataset used for training and evaluation in this study is:

  • VinDr-CXR: This is described as the largest public dataset for lung chest radiograph detection. It contains over 100,000 chest radiographs with detailed annotations. The dataset was collected from two major hospitals in Vietnam, with manual labeling by 17 professional radiologists. It includes 22 types of lesions with local labels and 6 types of special lesions with global labels. For this study, 8 smaller categories were merged, resulting in a final task of object detection for 14 lesion categories. The dataset is split into 15,000 training images and 3,000 test images.

Key Insights and Ideas

  • Synergy of RepVGG and Resblocks: The paper highlights that combining RepVGG's ability to enrich single-layer features with Resblock's capacity for cross-layer feature fusion creates a more powerful and efficient backbone (RRNet) for medical image analysis, outperforming individual components or standard backbones like ResNet-34 in terms of accuracy and parameter count.
  • The Value of Underutilized Features: The "Information Reuse" module demonstrates that even seemingly underutilized features in existing architectures can significantly boost performance when strategically re-integrated, suggesting a broader principle for optimizing deep learning models.
  • Efficiency for Clinical Deployment: The research emphasizes that achieving a good balance between detection accuracy and inference speed is crucial for practical CAD systems, especially in resource-constrained environments. CXR-RefineDet's performance metrics suggest it's a strong candidate for such applications.
  • Domain Specificity Matters: The authors note that ImageNet pre-trained models, while effective for natural images, may not be optimal for medical images due to domain mismatch. Training from scratch, as done with their proposed model, can be a viable alternative for specialized tasks.

Key Results

The CXR-RefineDet model achieved the following key results on the VinDr-CXR dataset:

  • Detection Accuracy: A mean Average Precision (mAP) of 0.1686 at a 512x512 resolution. This is reported to be better than mainstream object detection models, including two-stage algorithms like Cascade RCNN and anchor-free methods like VFNet and ATSS.
  • Inference Speed: An inference speed of 6.8 frames per second (fps) at a 512x512 resolution. While slower than the original RefineDet with a VGG-16 backbone, it's presented as a competitive speed for its improved accuracy and is considered fast enough for actual CAD system implementation.
  • Parameter Efficiency: The RRNet backbone is designed to have fewer parameters than comparable backbones like ResNet-50/101, contributing to a more efficient model.
  • Contribution of Components: Ablation studies indicated that the RRNet backbone and the Information Reuse structure individually contributed to performance improvements, with Information Reuse providing a 0.72% mAP boost.

Limitations and Future Work

  • Small Lesion Detection: The paper acknowledges that even with the proposed improvements, the model may still miss some very small targets or lesions with extreme aspect ratios, particularly at lower input resolutions (e.g., 512x512).
  • Model Complexity vs. Performance: The authors mention that to reduce model complexity and parameters, the network has fewer layers, which inherently limits its detection ability.
  • Future Directions: While not explicitly detailed, the authors suggest that the fast reasoning speed and improved accuracy of CXR-RefineDet provide a solid foundation for the actual implementation of computer-aided diagnosis systems. Further research could explore higher resolutions, more advanced data augmentation techniques, or ensemble methods to further improve the detection of challenging lesion types.

Summary updated

Abstract

The workload of radiologists has dramatically increased in the context of the COVID-19 pandemic, causing misdiagnosis and missed diagnosis of diseases. The use of artificial intelligence technology can assist doctors in locating and identifying lesions in medical images. In order to improve the accuracy of disease diagnosis in medical imaging, we propose a lung disease detection neural network that is superior to the current mainstream object detection model in this paper. By combining the advantages of RepVGG block and Resblock in information fusion and information extraction, we design a backbone RRNet with few parameters and strong feature extraction capabilities. After that, we propose a structure called Information Reuse, which can solve the problem of low utilization of the original network output features by connecting the normalized features back to the network. Combining the network of RRNet and the improved RefineDet, we propose the overall network which was called CXR-RefineDet. Through a large number of experiments on the largest public lung chest radiograph detection dataset VinDr-CXR, it is found that the detection accuracy and inference speed of CXR-RefineDet have reached 0.1686 mAP and 6.8 fps, respectively, which is better than the two-stage object detection algorithm using a strong backbone like ResNet-50 and ResNet-101. In addition, the fast reasoning speed of CXR-RefineDet also provides the possibility for the actual implementation of the computer-aided diagnosis system.
BibTeX
@article{lin2022cxr,
  author = {Cong Lin and Yongbin Zheng and Xiuchun Xiao and Jialun Lin},
  title = {{CXR-RefineDet: Single-Shot Refinement Neural Network for Chest X-Ray Radiograph Based on Multiple Lesions Detection}},
  journal = {Journal of Healthcare Engineering},
  year = {2022},
  doi = {10.1155/2022/4182191},
}
Figure