Cloud-Based Automated Clinical Decision Support System for Detection and Diagnosis of Lung Cancer in Chest CT

Anum Masood, Po Yang, Bin Sheng, Huating Li, Ping Li, Jing Qin, Vitaveska Lanfranchi, Jinman Kim, Dagan FengIEEE Journal of Translational Engineering in Health and Medicine 2019 · DOI

TL;DR

This paper introduces a novel cloud-based, 3D deep learning system for automated detection and diagnosis of lung cancer in CT scans. By combining a multi-Region Proposal Network (mRPN) for candidate detection with a 3D Convolutional Neural Network (3DDCNN) for false positive reduction, the system achieves state-of-the-art performance, significantly aiding radiologists in early lung cancer diagnosis.

What Problem Does This Paper Address?

Lung cancer is a leading cause of cancer-related deaths, and early detection is crucial for improving patient survival rates. However, manually identifying and delineating pulmonary nodules in CT scans is a time-consuming and tedious task for radiologists. Existing Computer-Aided Diagnosis (CAD) systems often struggle with the diverse morphological variations of nodules and can be computationally expensive. This paper aims to address these challenges by developing a more accurate, efficient, and automated system that leverages 3D information from CT scans and integrates cloud computing for enhanced scalability and accessibility.

Methods

The proposed system employs a two-stage approach:

  • Candidate Detection (mRPN): The system utilizes a novel Multi-Region Proposal Network (mRPN) built upon a modified VGG-16 architecture. This mRPN is designed to handle the diversity in nodule sizes and limited labeled datasets by incorporating multi-resolution feature extraction and a cascade of region proposal networks (RPNs) with varied anchor sizes. A key innovation is the use of a deconvolutional layer to upsample feature maps, helping to recover information lost during downsampling and thus improving the detection of small nodules.
  • False Positive Reduction (3DDCNN): For the second stage, a 3D Deep Convolutional Neural Network (3DDCNN), inspired by the ResNet-101 architecture, is employed. This network processes 3D patches of CT scans to predict the presence of nodules or classify them based on malignancy. The 3DDCNN incorporates 3D convolutions, batch normalization, and residual units to effectively learn from volumetric data.
  • Cloud Integration: The system is integrated with cloud computing infrastructure (IaaS and SaaS) to provide GPU acceleration, fast computation, and on-demand scalability. This allows for efficient processing and real-time review by multiple radiologists.

Datasets

The system was trained and validated using several publicly available and clinical datasets:

  • LUNA16: A large dataset of 888 annotated CT scans used for training and validation.
  • ANODE09: A dataset used for validation, with a smaller number of annotated scans.
  • LIDC-IDR: The Lung Image Database Consortium image collection, used for validation and comparison.
  • Shanghai Sixth People's Hospital Dataset: A clinical dataset of 120 cases used for evaluating the system's performance in a real-world clinical setting.

Key Insights and Ideas

  • Leveraging 3D Information: The paper strongly emphasizes the importance of using 3D volumetric data from CT scans, rather than just 2D slices, for more accurate nodule detection and characterization.
  • Multi-Scale and Multi-View Processing: The use of multi-scale and multi-view ROI patches during pre-processing helps the model capture nodule attributes invariant to image transformations and better handle the spatial structure of anatomical features.
  • mRPN for Robust Candidate Detection: The novel mRPN architecture addresses the challenge of diverse nodule sizes and limited data by using a cascaded approach and a deconvolutional layer to improve the recovery of small nodule information.
  • Cloud Computing for Scalability and Efficiency: Integrating cloud infrastructure significantly enhances the system's performance by providing computational power, storage, and enabling real-time collaboration among radiologists, making it a cost-effective and scalable solution.
  • End-to-End System: The proposed system integrates both nodule detection and false positive reduction into a single, automated pipeline, aiming to provide a comprehensive diagnostic aid.

Key Results

The proposed cloud-based 3DDCNN system demonstrated superior performance across various datasets:

  • LUNA16: Achieved an impressive 98.7% sensitivity at 1.97 False Positives (FPs) per scan.
  • General Performance: The system attained a sensitivity of 98.4%, specificity of 92%, AUROC of 96%, and accuracy of 98.51% with 2.1 FPs per scan on combined datasets.
  • Comparison to State-of-the-Art: The system outperformed existing state-of-the-art CAD systems on LUNA16, showing a significant improvement in FROC scores.
  • Clinical Dataset: On a clinical dataset from Shanghai Sixth People's Hospital, the cloud-based system achieved a sensitivity of 98.7% with 1.97 FPs/scan, outperforming stand-alone CAD systems.
  • Processing Time: The cloud-based system achieved a processing time of approximately 219 ± 25.47 seconds per case, which is significantly faster than some other deep learning object detection methods.

Limitations and Future Work

The authors acknowledge several limitations and suggest future research directions:

  • Micro Nodule Detection: The system's accuracy was relatively less accurate in detecting micro nodules (diameter less than 3 mm). Future work will focus on improving the detection of these smaller nodules.
  • Data Augmentation: While data augmentation was used, further exploration of more robust methods is suggested to increase training samples and reduce overfitting, especially for datasets with less common nodule types.
  • Scalability and Generalization: Future work aims to extend the training stage to include data from more hospitals worldwide to improve the system's scalability and generalization across diverse populations and imaging protocols.
  • Nodule Type Performance: The goal is to develop a CAD system that performs well on all nodule types, even when dealing with datasets containing a limited number of specific nodule types.

Summary updated

Abstract

Lung cancer is a major cause for cancer-related deaths. The detection of pulmonary cancer in the early stages can highly increase survival rate. Manual delineation of lung nodules by radiologists is a tedious task. We developed a novel computer-aided decision support system for lung nodule detection based on a 3D Deep Convolutional Neural Network (3DDCNN) for assisting the radiologists. Our decision support system provides a second opinion to the radiologists in lung cancer diagnostic decision making. In order to leverage 3-dimensional information from Computed Tomography (CT) scans, we applied median intensity projection and multi-Region Proposal Network (mRPN) for automatic selection of potential region-of-interests. Our Computer Aided Diagnosis (CAD) system has been trained and validated using LUNA16, ANODE09, and LIDC-IDR datasets; the experiments demonstrate the superior performance of our system, attaining sensitivity, specificity, AUROC, accuracy, of 98.4%, 92%, 96% and 98.51% with 2.1 FPs per scan. We integrated cloud computing, trained and validated our Cloud-Based 3DDCNN on the datasets provided by Shanghai Sixth People's Hospital, as well as LUNA16, ANODE09, and LIDC-IDR. Our system outperformed the state-of-the-art systems and obtained an impressive 98.7% sensitivity at 1.97 FPs per scan. This shows the potentials of deep learning, in combination with cloud computing, for accurate and efficient lung nodule detection via CT imaging, which could help doctors and radiologists in treating lung cancer patients.
BibTeX
@article{masood2019cloud,
  author = {Anum Masood and Po Yang and Bin Sheng and Huating Li and Ping Li and Jing Qin and Vitaveska Lanfranchi and Jinman Kim and Dagan Feng},
  title = {{Cloud-Based Automated Clinical Decision Support System for Detection and Diagnosis of Lung Cancer in Chest CT}},
  journal = {IEEE Journal of Translational Engineering in Health and Medicine},
  year = {2019},
  doi = {10.1109/jtehm.2019.2955458},
}
Figure