Deep learning-enabled 3D multimodal fusion of cone-beam CT and intraoral mesh scans for clinically applicable tooth-bone reconstruction
Lists
Only you see this
Abstract
High-fidelity three-dimensional (3D) models of tooth-bone structures are valuable for virtual dental treatment planning; however, they require integrating data from cone-beam computed tomography (CBCT) and intraoral scans (IOS) using methods that are either error-prone or time-consuming. Hence, this study presents Deep Dental Multimodal Fusion (DDMF), an automatic multimodal framework that reconstructs 3D tooth-bone structures using CBCT and IOS. Specifically, the DDMF framework comprises CBCT and IOS segmentation modules as well as a multimodal reconstruction module with novel pixel representation learning architectures, prior knowledge-guided losses, and geometry-based 3D fusion techniques. Experiments on real-world large-scale datasets revealed that DDMF achieved superior segmentation performance on CBCT and IOS, achieving a 0.17 mm average symmetric surface distance (ASSD) for 3D fusion with a substantial processing time reduction. Additionally, clinical applicability studies have demonstrated DDMF’s potential for accurately simulating tooth-bone structures throughout the orthodontic treatment process.
BibTeX
@article{liu2023deep,
author = {Jiaxiang Liu and Jin Hao and Hangzheng Lin and Wei Pan and Jianfei Yang and Yang Feng and Gaoang Wang and Jin Li and Zuolin Jin and Zhihe Zhao and Zuozhu Liu},
title = {{Deep learning-enabled 3D multimodal fusion of cone-beam CT and intraoral mesh scans for clinically applicable tooth-bone reconstruction}},
journal = {Patterns},
year = {2023},
doi = {10.1016/j.patter.2023.100825},
}Loading related content...