Using mixed reality technique combines multimodal imaging signatures to adjuvant glioma photodynamic therapy

Jiawei Dong, Fang Wang, Yuyun Xu, Xin Gao, Hongtao Zhao, Jiheng Zhang, Nan Wang, Zhihui Liu, Xiuwei Yan, Jiaqi Jin, Hang Ji, Ruiqi Cheng, Lihai Wang, Zhaowen Qiu, Shaoshan HuFrontiers in Medicine 2023 · DOI

Abstract

Using the Mixed Reality technique combines multimodal imaging signatures to adjuvant glioma PDT can better exploit the vascular sealing effect of PDT on glioma.

Introduction

Malignant gliomas present a significant clinical challenge due to their extensive infiltration into healthy brain tissue, which often precludes complete surgical resection. Photodynamic Therapy (PDT) has emerged as a promising adjuvant treatment, utilizing light-sensitive drugs to induce tumor cell death and microvascular collapse. However, the efficacy of PDT is highly dependent on precise targeting. Currently, neurosurgeons often rely on subjective visual judgment to apply PDT. There is a critical need for objective methods to identify "hyperperfused" tumor zones—areas with high blood flow that drive rapid growth and recurrence—which are frequently invisible to the naked eye during surgery.

Methodology: A Multimodal Mixed Reality Pipeline

The researchers developed a comprehensive workflow to integrate advanced imaging with intraoperative visualization to guide "gradient PDT."

Flowchart of the integrated surgical workflow, from patient consent and MRI examination to 3D model construction and intraoperative application.

The pipeline consists of several key stages:

  1. Multimodal Imaging: Patients undergo 3.0-T MRI scans, including T1-weighted contrast-enhanced (T1WI+C) imaging, Perfusion-Weighted Imaging (PWI) to measure cerebral blood flow (CBF), and Diffusion Tensor Imaging (DTI) to map critical nerve fiber tracts.
  2. 3D Reconstruction and Fusion: Using the "Tuoying" system, these data types are fused into a single 3D digital model. This model highlights the tumor body, nerve bundles, and specific hyperperfusion "hotspots."
  3. Mixed Reality (MR) Integration: The 3D models are imported into Microsoft HoloLens. During surgery, the surgeon wears the headset to see the virtual tumor and its blood supply superimposed directly onto the patient’s anatomy.
MRI and PWI images showing Cerebral Blood Flow (CBF) maps and identified hyperperfusion zones.

Gradient Photodynamic Therapy

A novel aspect of this study is the application of "gradient PDT." Instead of a uniform light dose, surgeons use the MR-guided map to deliver a higher laser power density (150–200 mW/cm²) to hyperperfused areas, while applying a standard dose (100 mW/cm²) to the rest of the tumor bed. This strategy aims to maximize the "vascular sealing" effect of PDT in the most aggressive parts of the tumor.

Biological Validation and Key Results

To validate the significance of the identified hyperperfusion hotspots, the team performed immunohistochemistry (IHC) on tissue samples.

  • Biological Correlation: IHC results confirmed that hyperperfusion tissue (HPT) had significantly higher expression of pro-angiogenic and growth markers, including CD31 (vessel density), VEGFA (growth factor), and EGFR (signaling receptor), compared to standard tumoral tissue (p < 0.001).
  • Prognostic Value: Analysis of The Cancer Genome Atlas (TCGA) database showed that high expression of these three markers is a strong predictor of poor prognosis, justifying the aggressive targeting of these zones.
  • Clinical Feasibility: The workflow was successfully implemented in a cohort of 10 patients. Surgeons reported high satisfaction with the 3D models for preoperative planning and intraoperative guidance.

Discussion and Future Directions

While the integration of MR and multimodal imaging shows great promise, several challenges remain. "Brain shift"—the deformation of brain tissue during surgery—can lead to misalignment between the static 3D model and the actual anatomy. Future work will focus on real-time updates to the models and larger clinical trials to quantify long-term survival benefits. Additionally, automating the 3D reconstruction process using AI could enhance the practical utility of this workflow in high-volume clinical settings.

Summary updated

Abstract

Using the Mixed Reality technique combines multimodal imaging signatures to adjuvant glioma PDT can better exploit the vascular sealing effect of PDT on glioma.
BibTeX
@inproceedings{dong2023using,
  author = {Jiawei Dong and Fang Wang and Yuyun Xu and Xin Gao and Hongtao Zhao and Jiheng Zhang and Nan Wang and Zhihui Liu and Xiuwei Yan and Jiaqi Jin and Hang Ji and Ruiqi Cheng and Lihai Wang and Zhaowen Qiu and Shaoshan Hu},
  title = {{Using mixed reality technique combines multimodal imaging signatures to adjuvant glioma photodynamic therapy}},
  booktitle = {Frontiers in Medicine},
  year = {2023},
  doi = {10.3389/fmed.2023.1171819},
}
Figure