Utilization of facial fat grafting augmented reality guidance system in facial soft tissue defect reconstruction

Kai Liu, Siyi Chen, Xudong Wang, Zhihui Ma, Steve Guofang ShenHead 2024 · DOI

Abstract

The visual navigation offered by the fat grafting AR guidance system presents obvious advantages in facial soft tissue defect reconstruction, facilitating enhanced precision and efficiency in these filling procedures.

Introduction

Restoring facial symmetry following trauma, tumor resection, or congenital defects is a complex surgical challenge often referred to as a "game of millimeters." While preoperative 3D imaging allows for meticulous planning, the transition to the operating room often introduces subjectivity. Surgeons typically rely on memory and visual estimation to translate 2D screen plans into 3D surgical maneuvers, leading to potential under- or over-correction. This study introduces an augmented reality (AR) guidance system designed to bridge the gap between digital planning and physical execution.

Methods and Materials

The researchers developed a comprehensive AR pipeline utilizing the Microsoft HoloLens 2. The workflow begins with a CT scan of the patient (or phantom model), which is converted into DICOM data and then into a 3D STL file. Using mirroring algorithms in Blender, a virtual "target" volume is created by cloning the healthy side of the face onto the defect side.

The Augmented Reality surgical pipeline, from CT scanning to real-time visualization.

To ensure precise alignment between the virtual plan and the physical subject, the team employed a custom 3D-printed bracket equipped with QR codes. The HoloLens 2 tracks these markers to achieve high-fidelity "virtual-real fusion," overlaying a translucent 3D model of the desired contour directly onto the surgical field.

Physical phantom model with registration markers and QR code bracket used for spatial alignment.

Experimental Results

The system was validated using 20 custom-designed phantom models simulating irregular facial soft tissue defects. Surgeons were divided into two groups: Group A utilized AR guidance, while Group B followed conventional manual methods.

Quantitative analysis revealed significant improvements in the AR-assisted group ($p < 0.05$):

  • Accuracy: Reconstruction error was reduced to 2.09 ± 0.56 mm, an improvement of over 35% compared to the control group's 3.23 ± 1.15 mm.
  • Efficiency: Procedure times were cut by nearly 30%, with the AR group averaging 25.45 ± 2.58 minutes versus 37.05 ± 3.34 minutes for the manual group.
  • Registration: The marker-based tracking system demonstrated robust performance with a registration accuracy of less than 1 mm.

Discussion

The primary advantage of this AR system is its ability to resolve the "hand-eye separation" problem. By keeping the surgeon's focus on the patient rather than a remote monitor, the system reduces cognitive load. Furthermore, the use of symmetry-based mirroring provides a personalized, mathematically derived target for reconstruction.

However, several challenges remain for clinical translation. The current study utilized rigid phantom models; future work must address real-time soft tissue deformation in living patients. Additionally, surgical plans must eventually account for biological variables such as autologous fat absorption rates and the effects of gravity on tissue positioning.

Conclusion

The HoloLens 2-based AR guidance system significantly enhances the precision and efficiency of facial fat grafting in a controlled environment. By providing real-time volumetric feedback, it offers a promising digital solution for complex craniofacial reconstructions.

Summary updated

Abstract

The visual navigation offered by the fat grafting AR guidance system presents obvious advantages in facial soft tissue defect reconstruction, facilitating enhanced precision and efficiency in these filling procedures.
BibTeX
@inproceedings{liu2024utilization,
  author = {Kai Liu and Siyi Chen and Xudong Wang and Zhihui Ma and Steve Guofang Shen},
  title = {{Utilization of facial fat grafting augmented reality guidance system in facial soft tissue defect reconstruction}},
  booktitle = {Head},
  year = {2024},
  doi = {10.1186/s13005-024-00445-x},
}
Figure