Deep learning predicts malignancy and metastasis of solid pulmonary nodules from CT scans

Junhao Mu, Kaiming Kuang, Min Ao, Weiyi Li, Haiyun Dai, Zubin Ouyang, Jingyu Li, Jing Huang, Shuliang Guo, Jiancheng Yang, Yang Li

TL;DR

Researchers have developed a 3D deep learning model that predicts not only whether a solid pulmonary nodule is malignant but also its likelihood of having already metastasized—all from a single initial CT scan. The model performs on par with senior clinicians and, when used as a collaborative tool, significantly boosts diagnostic accuracy across all experience levels.

What Problem Does This Paper Address?

Solid pulmonary nodules (PNs) are a common finding in lung cancer screenings, but they are notoriously difficult to characterize. Unlike "ground-glass" nodules, which have more distinct features, solid nodules often look similar whether they are benign or malignant.

The stakes are high: an incorrect assessment can lead to "watchful waiting" for an aggressive cancer (allowing it to spread) or unnecessary, invasive surgeries for benign lesions. Furthermore, even if a nodule is identified as cancerous, determining if it has already metastasized (spread) usually requires expensive and time-consuming follow-up tests like PET-CTs or biopsies. This paper seeks to provide a non-invasive, "one-stop" AI solution to predict both malignancy and metastatic potential at the moment of initial diagnosis.

Methods

The researchers employed a 3D ResNet18 architecture, a convolutional neural network (CNN) optimized for volumetric data.

  • Preprocessing: To ensure the model focused on the right features, the team resampled CT volumes to a 1mm isotropic spacing and cropped 64x64x64 mm patches around the nodule center. They also "clipped" Hounsfield Units (HU)—the standard measure of radiodensity—to a range of [-1000, 400] to filter out irrelevant noise like bone or air.
  • Classification: The network was trained to output probabilities for three distinct classes: benign nodules, Ia-stage lung cancer (localized), and T1-stage lung cancer with metastasis.
  • Human-Computer Collaboration: A standout feature of this study is the "collaboration" formula. Instead of replacing the doctor, the researchers combined the model’s probability score with a binary "yes/no" diagnosis from a clinician using a weighted average. This allowed them to test if the AI could act as a "force multiplier" for human expertise.

Datasets

The study used a retrospective dataset from the First Affiliated Hospital of Chongqing Medical University, covering cases from January 2019 to April 2022.

  • Total Cohort: 689 patients with solid PNs.
  • Groups: 333 benign cases, 196 Ia-stage cases, and 160 T1-stage cases with confirmed metastasis.
  • Split: The data was randomized 8:2 into a training set (555 cases) and a held-out testing set (134 cases).
  • Ground Truth: Diagnoses were confirmed via pathology (biopsy/surgery) or long-term (2-year) follow-up for benign cases.

Key Insights and Ideas

  • Predicting the Unseen: The most impressive insight is that the model can predict metastasis by looking only at the primary lung lesion. This suggests that the "signature" of an aggressive, metastatic cancer is encoded within the primary tumor's visual features, even if the spread isn't visible on that specific scan.
  • The Stability Gap: The study found very low "inter-rater consistency" (Cohen’s kappa) among human clinicians. Doctors often disagree with each other on the same scan. The AI provides a stable, reproducible baseline that doesn't suffer from fatigue or subjective bias.
  • Better Together: The "Human-AI" collaboration outperformed either the AI or the humans working in isolation. Even for senior radiologists, adding the AI's "opinion" pushed their diagnostic accuracy to new heights.
  • Differential Difficulty: The model performed significantly better on "follow-up benign" cases (where the nodule shrinks or stays the same over time) than on "pathological benign" cases (where the nodule looks suspicious enough to warrant a biopsy but turns out to be benign). This highlights that some benign lesions are "mimics" that remain a challenge for both man and machine.

Key Results

  • Malignancy Prediction: The model achieved an AUC of 80.37%.
  • Metastasis Prediction: The model achieved an AUC of 86.44%.
  • Benchmarking: The AI outperformed junior clinicians and 5-year experienced respiratory clinicians by "considerable margins." It was on par with a 10-year senior respiratory clinician and only slightly trailed a senior radiologist.
  • Collaboration Boost: When the AI was combined with human input, the combined AUC scores jumped to 81.80%–88.70%. Specifically, combining the model with a senior radiologist resulted in the highest overall performance (AUC 88.70%).

Limitations and Future Work

The authors acknowledge several hurdles before this hits every clinic:

  1. Single-Center Study: The data comes from one hospital. To prove the model is robust, it needs to be tested on "external" datasets from different hospitals and different CT scanner manufacturers.
  2. Sample Size: While large for this specific niche, 160 metastatic cases is still relatively small for deep learning.
  3. Modality Silos: The current model only looks at CT images. The authors suggest that future versions should incorporate "multi-omics" (clinical data, smoking history, and biomarkers) to create a more holistic prediction.
  4. Prospective Validation: This was a retrospective look at old data. The next step is a prospective study—using the AI in real-time as patients come in—to see if it truly changes clinical outcomes.

Summary updated

Abstract

In the clinic, it is difficult to distinguish the malignancy and aggressiveness of solid pulmonary nodules (PNs). Incorrect assessments may lead to delayed diagnosis and an increased risk of complications. We developed and validated a deep learning-based model for the prediction of malignancy as well as local or distant metastasis in solid PNs based on CT images of primary lesions during initial diagnosis. In this study, we reviewed the data from multiple patients with solid PNs at our institution from 1 January 2019 to 30 April 2022. The patients were divided into three groups: benign, Ia-stage lung cancer, and T1-stage lung cancer with metastasis. Each cohort was further split into training and testing groups. The deep learning system predicted the malignancy and metastasis status of solid PNs based on CT images, and then we compared the malignancy prediction results among four different levels of clinicians. Experiments confirmed that human-computer collaboration can further enhance diagnostic accuracy. We made a held-out testing set of 134 cases, with 689 cases in total. Our convolutional neural network model reached an area under the ROC (AUC) of 80.37% for malignancy prediction and an AUC of 86.44% for metastasis prediction. In observer studies involving four clinicians, the proposed deep learning method outperformed a junior respiratory clinician and a 5-year respiratory clinician by considerable margins; it was on par with a senior respiratory clinician and was only slightly inferior to a senior radiologist. Our human-computer collaboration experiment showed that by simply adding binary human diagnosis into model prediction probabilities, model AUC scores improved to 81.80-88.70% when combined with three out of four clinicians. In summary, the deep learning method can accurately diagnose the malignancy of solid PNs, improve its performance when collaborating with human experts, predict local or distant metastasis in patients with T1-stage lung cancer, and facilitate the application of precision medicine.
BibTeX
@inproceedings{mu2023deep,
  author = {Junhao Mu and Kaiming Kuang and Min Ao and Weiyi Li and Haiyun Dai and Zubin Ouyang and Jingyu Li and Jing Huang and Shuliang Guo and Jiancheng Yang and Yang Li},
  title = {{Deep learning predicts malignancy and metastasis of solid pulmonary nodules from CT scans}},
  booktitle = {Frontiers in Medicine},
  year = {2023},
  doi = {10.3389/fmed.2023.1145846},
}
Figure