Deep multi-task prediction of lung cancer and cancer-free progression from censored heterogenous clinical imaging

Riqiang Gao, Lingfeng Li, Yucheng Tang, Sanja L. Antic, Alexis B. Paulson, Yuankai Huo, Kim L. Sandler, Pierre P. Massion, Bennett A. Landman

Introduction

Annual low-dose CT screening is a critical tool for early lung cancer detection in high-risk smokers. However, the process is inherently inefficient: fewer than 5% of screened high-risk patients actually develop the disease, leading to a high volume of negative scans and significant healthcare resource consumption. Traditional AI models focus on binary classification—determining if cancer is present in a current scan. This approach ignores the temporal dimension of the disease and the "censored" nature of clinical data, where a patient may be cancer-free at their last scan but their future status remains unknown.

Researchers at Vanderbilt University have addressed this by developing a multi-task deep learning model that simultaneously performs diagnosis (classification) and prognosis (predicting Cancer-Free Progression Time, or CFPT). By predicting how long a patient will remain cancer-free, clinicians can potentially personalize screening intervals, reducing costs and radiation exposure for low-risk individuals.

Methodology

The proposed architecture is a multi-task 3D convolutional neural network (CNN) utilizing an attention mechanism. The model processes two inputs: the 3D CT volume and a "nodule mask" from a pre-processing pipeline, ensuring the network focuses on suspicious regions while maintaining global lung context.

Censored Regression Loss (CRL)

The technical core of this research is the Censored Regression Loss (CRL). Standard regression metrics like Mean Squared Error are unsuitable for medical datasets where the exact "event time" (cancer onset) is often missing. CRL allows the model to learn from three distinct clinical scenarios:

  1. Non-cancer patients: No penalty is applied if the model predicts a cancer-free duration extending beyond the patient's last known negative scan.
  2. Cancer patients (pre-diagnosis): The model is trained to regress toward the known future date of diagnosis.
  3. Cancer patients (post-diagnosis): No penalty is applied for predicting a very short cancer-free time, as the disease is already present.
Visualization of the Censored Regression Loss (CRL) across different clinical scenarios.

By combining CRL with standard Cross-Entropy Loss (CEL), the model treats every negative scan as a lower bound for cancer-free time, extracting incremental value from data that traditional models would largely ignore.

Key Results

The study utilized a joint cohort of 2,287 scans from 1,433 patients. The multi-task approach demonstrated that teaching a model when cancer will occur significantly improves its ability to identify if it is currently present.

The integrated model (CEL+CRL) achieved a state-of-the-art AUC of 0.895, outperforming both the single-task classification model (0.878) and the previous Kaggle Lung Cancer Competition benchmark (0.856).

ROC curves comparing the multi-task model (CEL+CRL) against single-task (CEL) and baseline methods.

Beyond diagnostic accuracy, the model showed high clinical utility. Using a 4-year CFPT threshold, the system achieved a 95.5% recall for cancer patients. Furthermore, it identified approximately 40% of non-cancer patients as "low priority," suggesting these individuals could safely extend their screening intervals.

Discussion and Future Work

This research highlights multi-tasking as a powerful regularizer in medical imaging. By deriving value from negative scans through CRL, the model learns more robust features than classification alone.

Future efforts will focus on integrating additional clinical priors—such as age, smoking history, and COPD status—directly into the architecture. The authors also aim to validate the model on larger national datasets, such as the National Lung Screening Trial (NLST), to further refine the precision of CFPT predictions across diverse clinical environments.

Summary updated

Abstract

Annual low dose computed tomography (CT) lung screening is currently advised for individuals at high risk of lung cancer (e.g., heavy smokers between 55 and 80 years old). The recommended screening practice significantly reduces all-cause mortality, but the vast majority of screening results are negative for cancer. If patients at very low risk could be identified based on individualized, image-based biomarkers, the health care resources could be more efficiently allocated to higher risk patients and reduce overall exposure to ionizing radiation. In this work, we propose a multi-task (diagnosis and prognosis) deep convolutional neural network to improve the diagnostic accuracy over a baseline model while simultaneously estimating a personalized cancer-free progression time (CFPT). A novel Censored Regression Loss (CRL) is proposed to perform weakly supervised regression so that even single negative screening scans can provide small incremental value. Herein, we study 2287 scans from 1433 de-identified patients from the Vanderbilt Lung Screening Program (VLSP) and the Consortium for Molecular and Cellular Characterization of Screen-Detected Lesions (MCL) cohorts. Using five-fold cross-validation, we train a 3D attention-based network under two scenarios: (1) single-task learning with only classification, and (2) multi-task learning with both classification and regression. The single-task learning leads to a higher AUC compared with the Kaggle challenge winner pre-trained model (0.878 v. 0.856), and multitask learning significantly improves the single-task one (AUC 0.895, p<0.01, McNemar test). In summary, the image based predicted CFPT can be used in follow-up year lung cancer prediction and data assessment.
BibTeX
@inproceedings{gao2020deep,
  author = {Riqiang Gao and Lingfeng Li and Yucheng Tang and Sanja L. Antic and Alexis B. Paulson and Yuankai Huo and Kim L. Sandler and Pierre P. Massion and Bennett A. Landman},
  title = {{Deep multi-task prediction of lung cancer and cancer-free progression from censored heterogenous clinical imaging}},
  booktitle = {Image Processing},
  year = {2020},
  doi = {10.1117/12.2548464},
}
Figure