DentalSplat: Dental Occlusion Novel View Synthesis from Sparse Intra-Oral Photographs

Yiyi Miao, Taoyu Wu, Tong Chen, Sihao Li, Ji Jiang, Youpeng Yang, Angelos Stefanidis, Limin Yu, Jionglong SuarXiv 2025 · DOI · arXiv

Abstract

DentalSplat is a novel 3D reconstruction framework that generates high-fidelity dental models from as few as three sparse, unposed intra-oral photographs. By combining the "pose-free" initialization of DUSt3R with an optimized 3D Gaussian Splatting (3DGS) pipeline, it enables accurate remote orthodontic monitoring using only a smartphone.

Introduction

In orthodontics, tracking dental occlusion—how teeth move and fit together—traditionally requires expensive clinical equipment such as Cone Beam Computed Tomography (CBCT) or Intraoral Scanners (IOS). While telemedicine allows patients to capture photos at home, these images are typically "sparse" (e.g., one front view and two side views) and "unposed," lacking camera position data.

Existing 3D reconstruction methods like standard 3D Gaussian Splatting (3DGS) or Neural Radiance Fields (NeRF) often fail in these scenarios. They typically require dozens of overlapping images and precise camera calibration (e.g., via COLMAP). Dental photos also present unique challenges, including specular reflections from enamel and motion blur. DentalSplat addresses these issues, providing clinical-grade 3D visualization from minimal, consumer-grade input.

Methodology

The DentalSplat framework employs a multi-stage pipeline that eliminates the need for traditional Structure-from-Motion (SfM) dependencies.

The DentalSplat pipeline, featuring pose-free initialization and optimized 3D Gaussian Splatting.

1. Pose-Free Initialization

Instead of relying on COLMAP, the framework utilizes DUSt3R, a geometric foundation model. DUSt3R regresses a dense point cloud and estimates camera poses directly from image pairs, providing a robust starting point for reconstruction.

2. Scale-Adaptive Pruning (SAP)

Point clouds generated by DUSt3R are often excessively dense for efficient 3DGS training. The Scale-Adaptive Pruning (SAP) module analyzes the spatial distribution of these points and applies adaptive thresholds to prune the cloud. This retains critical geometry while significantly reducing computational overhead.

3. Optical Flow Constraints

To bridge the extreme angular gaps between sparse viewpoints, the authors incorporate a bidirectional optical flow loss. This acts as a geometric "glue," ensuring that 3D Gaussians remain consistent across different views even with minimal visual overlap.

4. Gradient-Weighted Optimization

To combat "Gradient Collision"—where conflicting signals from different pixels cause blurring—the authors apply an absolute operation to gradients. This ensures that the densification of Gaussians is guided by clear directional signals, resulting in sharper edges on tooth structures.

Experimental Evaluation

The researchers validated DentalSplat on two clinical datasets: a Video Test Dataset (195 cases) for rigorous evaluation and a 3-View Image Dataset (950 cases) representing the standard remote monitoring challenge.

Key Results

DentalSplat significantly outperformed state-of-the-art baselines like InstantSplat and CF-3DGS:

  • Accuracy: On the 3-view dataset, DentalSplat achieved a PSNR of 34.50, compared to 32.78 for InstantSplat. Standard 3DGS failed to converge on such sparse data.
  • Efficiency: The system completes a full 3D reconstruction in approximately 69 seconds on a consumer-grade RTX 4090 GPU.
  • Visual Fidelity: Qualitative results demonstrate successful reconstruction of molar surfaces and gingival margins without the "melting" or "ghosting" artifacts common in other sparse-view methods.

Conclusion

DentalSplat demonstrates that while 3DGS is excellent at rendering, its performance in sparse settings is greatly enhanced by using foundation models like DUSt3R for initialization. By intelligently pruning initial point clouds and applying flow-based constraints, high-quality dental models can be generated from minimal input.

Future work may involve integrating domain-specific anatomical priors to improve robustness against poor lighting or extreme occlusion. Additionally, optimizing the pipeline for mobile-real-time execution could provide patients with instant feedback during the photo-taking process.

Summary updated

Abstract

In orthodontic treatment, particularly within telemedicine contexts, observing patients' dental occlusion from multiple viewpoints facilitates timely clinical decision-making. Recent advances in 3D Gaussian Splatting (3DGS) have shown strong potential in 3D reconstruction and novel view synthesis. However, conventional 3DGS pipelines typically rely on densely captured multi-view inputs and precisely initialized camera poses, limiting their practicality. Orthodontic cases, in contrast, often comprise only three sparse images, specifically, the anterior view and bilateral buccal views, rendering the reconstruction task especially challenging. The extreme sparsity of input views severely degrades reconstruction quality, while the absence of camera pose information further complicates the process. To overcome these limitations, we propose DentalSplat, an effective framework for 3D reconstruction from sparse orthodontic imagery. Our method leverages a prior-guided dense stereo reconstruction model to initialize the point cloud, followed by a scale-adaptive pruning strategy to improve the training efficiency and reconstruction quality of 3DGS. In scenarios with extremely sparse viewpoints, we further incorporate optical flow as a geometric constraint, coupled with gradient regularization, to enhance rendering fidelity. We validate our approach on a large-scale dataset comprising 950 clinical cases and an additional video-based test set of 195 cases designed to simulate real-world remote orthodontic imaging conditions. Experimental results demonstrate that our method effectively handles sparse input scenarios and achieves superior novel view synthesis quality for dental occlusion visualization, outperforming state-of-the-art techniques.
BibTeX
@misc{miao2025dentalsplat,
  author = {Yiyi Miao and Taoyu Wu and Tong Chen and Sihao Li and Ji Jiang and Youpeng Yang and Angelos Stefanidis and Limin Yu and Jionglong Su},
  title = {{DentalSplat: Dental Occlusion Novel View Synthesis from Sparse Intra-Oral Photographs}},
  year = {2025},
  eprint = {2511.03099},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2511.03099},
}
Figure