Diffusion-based Radiotherapy Dose Prediction Guided by Inter-slice Aware Structure Encoding

Zhenghao Feng, Lu Wen, Jianghong Xiao, Yuanyuan Xu, Xi Wu, Jiliu Zhou, Xingchen Peng, Yan Wang

TL;DR

DiffDose is a new diffusion-based model that predicts radiotherapy dose distributions with high precision, specifically tackling the "over-smoothing" problem found in traditional deep learning methods. By combining a generative diffusion process with a novel inter-slice transformer, it produces dose maps that preserve sharp, clinically essential details like beam directions and dose gradients.

What Problem Does This Paper Address?

In radiotherapy, the goal is to blast a tumor (the Planning Target Volume, or PTV) with radiation while sparing nearby healthy organs (Organs at Risk, or OARs). Creating these plans manually is a "trial-and-error" process that is both slow and dependent on a dosimetrist's expertise.

While deep learning models like UNets have automated this, they typically rely on $L_1$ or $L_2$ loss functions. These functions tend to calculate a "posterior average," which results in over-smoothed dose maps. In a clinical setting, this means losing high-frequency details—such as the distinct "ray shapes" of radiation beams—which are critical for understanding how dose is actually being delivered. GANs (Generative Adversarial Networks) can help, but they are notoriously unstable to train and often introduce "hallucinated" artifacts.

Methods

The authors introduce DiffDose, which treats dose prediction as a conditional image generation task using a Denoising Diffusion Probabilistic Model (DDPM).

  1. The Diffusion Process: The model learns to reverse a process that gradually adds noise to a real dose map. By learning to "denoise" starting from pure Gaussian noise, it can generate highly detailed, non-blurry dose distributions.
  2. Structure Encoder: To ensure the dose matches the patient's anatomy, a ResNet-18-based encoder processes the CT scans and segmentation masks (PTV and OARs). This "anatomical knowledge" guides the denoising process.
  3. Inter-slice Interaction Transformer (I2T): Most dose prediction is done on 2D slices to save memory, but radiation is inherently 3D. The I2T block uses multi-head attention to allow the model to "look" at neighboring slices within a batch, capturing the continuity and dependencies of the 3D volume.
  4. Adaptive Weighted Loss: Not all pixels are equal. The authors designed a loss function that penalizes errors more heavily in the PTV and OAR regions compared to the background, forcing the model to prioritize clinical accuracy where it matters most.

Datasets

The study utilized an in-house clinical dataset from West China Hospital:

  • Cohort: 130 rectum cancer patients.
  • Data: CT images, PTV masks, OAR masks (bladder, femoral heads, small intestine), and the original clinically approved dose plans.
  • Processing: 3D volumes were sliced into 160x160 2D images, resulting in over 21,000 slices for training, validation, and testing.

Key Insights and Ideas

  • Diffusion > Regression: The most significant "aha" moment is that diffusion models are fundamentally better at capturing the high-frequency "texture" of radiation beams than standard regression models.
  • The 2D-to-3D Bridge: The I2T block is a clever workaround for the "3D vs. 2D" dilemma. It provides the benefits of 3D spatial context (crucial for "base" and "apex" slices of a tumor) without the massive computational overhead of full 3D convolutional networks.
  • Clinical Weighting: The adaptive loss acknowledges that a 1Gy error inside a tumor is much worse than a 1Gy error in the air outside the patient. This alignment of the loss function with clinical goals is key to the model's superior performance.

Key Results

DiffDose was compared against seven state-of-the-art (SOTA) methods, including UNet, DeepLabV3+, and Mc-GAN.

  • Quantitative: DiffDose achieved the best "Dose Score" (a measure of mean error across ROIs) and significantly lower errors in $D_{50}$ (median dose) and $D_{98}$ (near-minimum dose) for the PTV.
  • Qualitative: Gradient maps (which highlight edges and changes) show that DiffDose captures sharp beam paths that other models completely blur out.
  • Ablation: Removing the I2T block or the structure encoder led to a measurable drop in accuracy, proving that both anatomical guidance and inter-slice context are necessary.

Limitations and Future Work

  • Inference Speed: Like all diffusion models, DiffDose is iterative. While the authors optimized it to 100 steps (taking ~2 minutes per patient), it is still slower than a single-pass UNet.
  • Single Site: The model was only tested on rectum cancer. Radiotherapy for other sites (like head and neck) involves much more complex OAR geometries and might require further tuning.
  • Dataset Diversity: As an in-house dataset, it remains to be seen how well the model generalizes to data from different hospitals or different CT scanner manufacturers.

The authors suggest that future work could involve further accelerating the sampling process and testing the framework on a wider variety of cancer types.

Summary updated

Abstract

Deep learning (DL) has successfully automated dose distribution prediction in radiotherapy planning, enhancing both efficiency and quality. However, existing methods suffer from the over-smoothing problem for their commonly used L1 or L2 loss with posterior average calculations. To alleviate this limitation, we propose a diffusion model-based method (DiffDose) for predicting the radiotherapy dose distribution of cancer patients. Specifically, the DiffDose model contains a forward process and a reverse process. In the forward process, DiffDose transforms dose distribution maps into pure Gaussian noise by gradually adding small noise and a noise predictor is simultaneously trained to estimate the noise added at each timestep. In the reverse process, it removes the noise from the pure Gaussian noise in multiple steps with the well-trained noise predictor and finally outputs the predicted dose distribution maps...
BibTeX
@misc{feng2023diffusion,
  author = {Zhenghao Feng and Lu Wen and Jianghong Xiao and Yuanyuan Xu and Xi Wu and Jiliu Zhou and Xingchen Peng and Yan Wang},
  title = {{Diffusion-based Radiotherapy Dose Prediction Guided by Inter-slice Aware Structure Encoding}},
  year = {2023},
  eprint = {2311.02991},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2311.02991},
}
Figure