GeminiNet: Combine Fully Convolution Network With Structure of Receptive Fields for Object Detection

Shangjie Yao, Yaowu Chen, Xiang Tian, Rongxin JiangIEEE Access 2020 · OpenReview

Abstract

Pneumonia remains a significant global health threat, necessitating efficient and accurate diagnostic tools. Automated detection using Chest X-ray (CXR) images via deep learning offers a promising path to reduce clinical workloads. However, standard object detection architectures often struggle with the balance between high-level semantic extraction and the preservation of spatial resolution. In this paper, we present GeminiNet, a specialized framework that integrates a Fully Convolutional Network (FCN) with a novel Receptive Field Block (RFB). By utilizing a DetNet59 backbone and a retina-like convolutional structure, GeminiNet expands the receptive field to capture multi-scale features without losing critical spatial information. Evaluated on the RSNA dataset, GeminiNet achieved an Average Precision (AP) of 0.4575 and an inference speed of 8 fps, outperforming standard ResNet-based Faster R-CNN models.

Introduction

The diagnosis of pneumonia from Chest X-rays (CXR) is a high-stakes task where accuracy and speed are paramount. While deep learning has revolutionized medical imaging, standard architectures often face a trade-off: deep layers capture global context but lose fine-grained local details due to downsampling, while shallow layers lack the semantic depth needed for complex classification. GeminiNet addresses this by rethinking the receptive field—the specific area of an input image that influences a given feature.

The Resolution-Localization Trade-off

Current state-of-the-art models for object detection face two primary technical bottlenecks in medical imaging:

  1. Resolution Loss: Backbones like ResNet utilize heavy downsampling. In deep layers, the semantic features of small targets, such as early-stage pneumonia opacities, can effectively disappear.
  2. The Fully Connected Bottleneck: Many detectors rely on fully connected (FC) layers for final classification. FC layers are computationally expensive and can discard spatial information necessary for precise bounding box localization.

The GeminiNet Architecture

GeminiNet is built upon the concept of Region-based Fully Convolutional Networks (R-FCN) but introduces several structural innovations to overcome the aforementioned bottlenecks.

DetNet59 Backbone

Instead of a standard classification backbone, GeminiNet employs DetNet59. This backbone is specifically designed for object detection, maintaining a higher feature map resolution in its later stages compared to traditional networks.

Receptive Field Block (RFB)

The core innovation of GeminiNet is the Receptive Field Block (RFB), integrated into the sixth stage of the network. Inspired by the human visual system, the RFB uses an Inception-like design with parallel branches of different kernel scales ($1 \times 1$, $1 \times 3$, $3 \times 1$, and $3 \times 3$) combined with dilated convolutions.

The internal structure of the Receptive Field Block (RFB) showing parallel multi-scale convolutions and dilated layers.

Dilated convolutions allow the network to "skip" pixels, effectively expanding the field of view to capture global context without increasing the parameter count or reducing resolution. This "retina-like" structure enables the model to process information at multiple scales simultaneously.

Dual-Branch Information Flow

The "Gemini" designation refers to the dual-stream processing of information. The network utilizes Position Sensitive Region of Interest (PSRoI) Pooling to capture local, part-based information and RoI Align to capture global context. By combining these streams, the model preserves the spatial "vote" of different image parts, ensuring translation variance—a critical requirement for accurate object localization.

Experimental Setup and Data

The model was rigorously tested using the RSNA Pneumonia Detection Challenge dataset, a subset of the NIH CXR14 dataset containing 30,000 exams.

Examples of pneumonia detection on CXR images (a-i) illustrating the model's localization and the use of data augmentation (flipping).

To address data scarcity and improve robustness, the authors implemented data augmentation through horizontal and vertical flipping. This expanded the training set and helped the model generalize better to variations in patient positioning.

Performance Analysis

GeminiNet demonstrated superior performance across several key metrics on the RSNA dataset:

  • Accuracy: At an IoU (Intersection over Union) threshold of 0.5, GeminiNet reached an Average Precision (AP) of 0.4575, an improvement of 0.078 over a standard ResNet50 baseline.
  • Classification Power: The model achieved an AUC of 0.7758, indicating high reliability in distinguishing between positive and negative pneumonia cases.
  • Efficiency: GeminiNet achieved a detection speed of 8 fps, outperforming the 7 fps typical of the popular Faster R-CNN architecture.
  • Comparative Gains: The architecture showed a 10.7% improvement in Mean Average Precision (mAP) over Mask R-CNN.

Conclusion

GeminiNet represents a significant step forward in automated pneumonia detection. By combining a detection-optimized backbone with a multi-scale receptive field block, it successfully balances the need for high-resolution spatial data with deep semantic context. While future work will explore attention mechanisms to further refine the weighting between local and global features, GeminiNet currently offers a high-performance, efficient solution for assisted medical reading.

Summary updated

Abstract

Pneumonia is a relatively common disease that will endanger the lives of patients if left untreated. End-to-end detection of pneumonia using neural networks will be helpful for reducing related workforce. CNN's processing of images shows remarkable performance, naturally, the use of CNN based methods for assisted reading will be a trend in modern medicine. The property of current detection algorithms is not yet satisfactory, so further research is extremely needed. In this article, we design GeminiNet to identify and localize the pneumonia in Chest X-ray (CXR) images. It uses a popular fully convolution architecture with computation shared on the entire image, combining RoI Align and PSRoI Pooling to capture global and local information and output. Our approach introduces DetNet59, a network designed specifically for detection to capture deep features. In the sixth stage of DetNet59, the structure of the retina-like convolutional layers is added to replace the fully connected layer. This structure uses the dilated convolution to extend the reconstructive field, and the convolution kernels of three different scales are used for parallel calculation to collect rich feature information. GeminiNet is validated on the RSNA dataset. We augment dataset by flipping on horizontal and vertical for the small amount of data. At IoU (Intersection over Union) =0.5, AP reached 0.4575, 0.078 higher than ResNet50, and reached 0.7758 on the AUC indicator. GeminiNet achieves 8fps in detection speed, which is better than the 7fps of the popular Faster R-CNN architecture.
BibTeX
@inproceedings{yao2020gemininet,
  author = {Shangjie Yao and Yaowu Chen and Xiang Tian and Rongxin Jiang},
  title = {{GeminiNet: Combine Fully Convolution Network With Structure of Receptive Fields for Object Detection}},
  booktitle = {IEEE Access},
  year = {2020},
  url = {https://openreview.net/forum?id=dVrsiGgXXDj},
}
Figure