Prediction of regional lymph node status in rectal cancer with radiomics features based on deep learning segmented tumor area

Wanting Zhao, Wanqing Li, Yongfei Hao, Xueying Qiao, Guorui Hou, Shaohua Du, Guangwen Zhang, Jinsong ZhangResearch Square 2024 · DOI

This research paper explores a more efficient way to predict whether rectal cancer has spread to regional lymph nodes—a critical factor in determining a patient's treatment plan. By combining state-of-the-art deep learning for tumor segmentation with radiomics (the extraction of thousands of quantitative features from medical images), the authors demonstrate that an automated AI workflow can match the diagnostic accuracy of time-consuming manual methods.

TL;DR

Researchers developed an automated pipeline that uses deep learning (nnU-Net v2) to identify rectal tumors on MRI and then predicts lymph node metastasis using radiomics. The AI-driven approach performed as well as manual human segmentation, achieving an AUC of 0.800 and offering a path toward faster, more objective clinical decision-making.

What Problem Does This Paper Address?

In rectal cancer, knowing the status of regional lymph nodes (LNM) is everything. If the cancer has spread to the nodes, patients typically need neoadjuvant therapy (chemo or radiation) before surgery. Currently, radiologists look at MRI scans to judge node status based on size and shape, but this is notoriously difficult and subjective, with sensitivities often hovering around 66%.

Radiomics—using computers to "mine" images for data invisible to the human eye—offers a solution. However, radiomics usually requires a human to manually trace the tumor (segmentation), which is tedious, slow, and varies between different doctors. This paper asks: Can we use deep learning to automate the tumor tracing without losing the accuracy of our cancer spread predictions?

Methods

The study followed a two-step "segment-then-predict" workflow:

  1. Auto-Segmentation: The authors compared three deep learning architectures—3D U-Net, 3D V-Net, and nnU-Net v2—to see which could best delineate the tumor on two types of MRI sequences: T2-weighted imaging (T2WI) and Diffusion-weighted imaging (DWI).
  2. Radiomics Prediction: After the AI (or a human) traced the tumor, the researchers extracted 1,036 radiomics features (texture, shape, and intensity) from the area. They then tested five different machine learning classifiers—including Logistic Regression (LR) and Random Forests—to predict LNM status.

The "secret sauce" here was the use of nnU-Net v2, a self-configuring framework that automatically adapts its architecture to the specific dataset it's given, rather than requiring manual tuning.

Datasets

The study retrospectively analyzed 282 patients with rectal cancer. To ensure the model wasn't just "memorizing" one specific type of image, they used data from two different MRI manufacturers:

  • Vendor 1: GE Discovery MR750 (218 patients).
  • Vendor 2: Siemens MAGNETOM TrioTim (64 patients).

The data was split into training, validation, and independent test sets to rigorously evaluate both the segmentation and the final prediction.

Key Insights and Ideas

  • The Superiority of nnU-Net v2: The nnU-Net v2 architecture significantly outperformed the older 3D U-Net and V-Net models. It achieved a Dice Similarity Coefficient (DSC)—a measure of overlap where 1.0 is perfect—of roughly 0.89 to 0.91.
  • AI is "Good Enough" for Radiomics: A common fear is that if an AI's segmentation isn't 100% perfect, the downstream data will be garbage. This paper shows that the radiomics features derived from AI-segmented areas were just as predictive as those from expert human-segmented areas.
  • Multimodality is Key: Models that combined both T2WI (which shows anatomy) and DWI (which shows cellular density) performed better than models using either sequence alone.
  • Simplicity Wins: Despite the complexity of the deep learning segmentation, the best-performing classifier for the final prediction was Logistic Regression, proving that once you have high-quality features, a straightforward statistical model is often the most robust.

Key Results

  • Segmentation Performance: nnU-Net v2 achieved a DSC of 0.886 on T2WI and 0.906 on DWI, far surpassing the 3D U-Net (0.548 and 0.583, respectively).
  • Prediction Accuracy: The best automated model (combining T2WI and DWI) achieved an AUC of 0.800 in the validation set.
  • Human vs. AI: There was no statistically significant difference ($p = 0.248$) between the performance of the manual-based model (AUC 0.833) and the AI-based model (AUC 0.800). This confirms that automation does not come at the cost of accuracy.

Limitations and Future Work

While promising, the study has a few hurdles to clear before hitting the clinic:

  • Single-Center Study: All data came from one hospital (Xijing Hospital). The authors acknowledge the need for external validation with datasets from other institutions.
  • Missing Visual Cues: The model focused purely on the tumor area. Future versions might improve by also incorporating traditional visual criteria of the lymph nodes themselves (like size and border irregularity).
  • The "Black Box" Problem: Deep learning and radiomics can be hard to interpret. The authors suggest that moving toward "explainable AI" will be necessary to help doctors trust the model's output.

Summary updated

Abstract

<title>Abstract</title> <bold>Background</bold>: To predict regional lymph node metastasis (LNM) in rectal cancer (RC) using deep learning-based tumor auto-segmentation and radiomics. <bold>Methods:</bold> This single-center research retrospectively analyzed 282 patients with RC from two MR vendors. The deep learning-based auto-segmentation models were constructed on T2WI and DWI with 3D U-Net, 3D V-Net, and nnU-Net v2 and assessed with the Dice Similarity Coefficient (DSC). Radiomics features on manual-based VOI (MbV) and deep learning-based VOI (DbV, with the highest DSC) were extracted respectively. After feature normalization and selection, five classifiers were used for radiomics model building and then for LNM prediction. The optimal model was selected using a 5-fold cross-validation strategy and evaluated with area under the curve (AUC), accuracy, specificity, and sensitivity. <bold>Results: </bold>The DSC of the nnU-Net v2 was significantly higher than that of the 3D U-Net and 3D V-Net (T2WI: 0.886 vs 0.548 vs 0.616, p &lt; 0.001; DWI: 0.906 vs 0.583 vs 0.433, p &lt; 0.001; test set). The AUC of DbV based-radiomics models (0.700 for T2WI, 0.667 for DWI, and 0.800 for T2WI + DWI) were comparable to those of the corresponding MbV-based radiomics models (0.633 for T2WI, <italic>p </italic>= 0.638; 0.700 for DWI, <italic>p </italic>= 0.544; and 0.833 for T2WI + DWI,<italic> p </italic>= 0.248) in LNM prediction. <bold>Conclusions: </bold>Radiomics features of T2WI and DWI based on nnU-net v2 segmented tumor area showed a reliable performance in predicting LNM in RC.
BibTeX
@inproceedings{zhao2024prediction,
  author = {Wanting Zhao and Wanqing Li and Yongfei Hao and Xueying Qiao and Guorui Hou and Shaohua Du and Guangwen Zhang and Jinsong Zhang},
  title = {{Prediction of regional lymph node status in rectal cancer with radiomics features based on deep learning segmented tumor area}},
  booktitle = {Research Square},
  year = {2024},
  doi = {10.21203/rs.3.rs-5416953/v1},
}
Figure