YOLOrtho -- A Unified Framework for Teeth Enumeration and Dental Disease Detection

Shenxiao Mei, Chenglong Ma, Feihong Shen, Huikai Wu

TL;DR

YOLOrtho is a unified, end-to-end deep learning framework that simultaneously identifies teeth (enumeration) and detects dental diseases from panoramic X-rays. By treating diseases as attributes of detected teeth and incorporating spatial-aware convolutions (CoordConv), the model outperforms complex diffusion-based architectures and provides a streamlined tool for clinical dental analysis.

What Problem Does This Paper Address?

In clinical dentistry, analyzing panoramic X-rays is a two-step manual process: first, identify the specific tooth (enumeration), and second, diagnose any pathologies (like caries or lesions). While AI has tackled these tasks individually, existing models usually require two separate stages or struggle to handle "partial annotations"—datasets where some images are labeled for position but not for disease.

Furthermore, teeth are structurally similar and packed closely together. Standard object detection models (like vanilla YOLO) are "translation invariant," meaning they are great at recognizing a tooth but struggle to distinguish between "Tooth 14" and "Tooth 15" because their identity depends almost entirely on their relative position in the jaw.

Methods

The authors built YOLOrtho upon the YOLOv8 architecture, introducing several key modifications to tailor it for dental radiography:

  • Multi-Attribute Heads: Instead of a single classification head, they modified the prediction heads to treat diseases as attributes. The model predicts four binary classifications for every detected tooth: is_impacted, has_caries, has_deepcaries, and has_lesion.
  • CoordConv Layers: To solve the "identity" problem, they replaced standard convolutions in the backbone with CoordConv. This adds extra coordinate channels (x, y) to the feature maps, giving the model explicit spatial context—essential for accurate tooth enumeration.
  • High-Resolution Feature Pyramid (FPN): Standard YOLOv8 uses strides of 8, 16, and 32. Because teeth are large and crowded, the authors added an extra upsampling layer to produce strides of 4, 8, and 16, allowing the model to capture finer details.
  • Hierarchical Loss & Pseudo-Labeling: To handle datasets that lacked disease labels, they used a hierarchical training strategy. They first trained a tooth detector to "pseudo-label" healthy teeth in partially annotated images, ensuring the model didn't mistakenly learn that an unlabeled tooth was "disease-free" simply because the label was missing.
  • Linear Sum Assignment: In post-processing, they applied a "one-tooth-one-ID" rule using linear sum assignment to prevent the model from assigning the same enumeration (FDI notation) to multiple physical teeth.

Datasets

The model was trained and validated using two primary sources:

  1. Dentex Challenge 2023: A complex dataset with three levels of labeling: quadrant only, quadrant + enumeration, and quadrant + enumeration + disease.
  2. Tufts Dental Public Dataset: Used to supplement the tooth detection and enumeration training.

Key Insights and Ideas

  • Position is Identity: In many computer vision tasks, you want the model to recognize a "cat" regardless of where it is in the frame. In dentistry, the location of the tooth defines what it is. Switching to CoordConv was a pivotal move to break translation invariance.
  • Diseases as Metadata: By formulating diseases as attributes rather than separate object classes, the model avoids the "overlapping box" problem where a tooth box and a caries box compete for the same space.
  • Bigger isn't always better: The authors note that YOLOrtho—a specialized version of a real-time detector—outperformed much larger, computationally expensive Diffusion-based models, proving that architectural domain-adaptation can be more effective than raw model scale.

Key Results

YOLOrtho showed significant improvements over baseline models in the Dentex Challenge:

Model AP-Quadrant AP-Diagnosis AP-Enumeration
Vanilla YOLO 0.395 0.330 0.286
YOLOrtho 0.414 0.357 0.337
HierarchicalDet 0.365 0.341 0.221

Ablation studies confirmed that the upsampling layer and CoordConv provided the most substantial boosts to Average Precision (AP), particularly for enumeration.

Limitations and Future Work

While the paper demonstrates a robust unified framework, a few areas remain for exploration:

  • Disease Variety: The current model focuses on four specific conditions (caries, deep caries, lesions, impacted teeth). Future iterations could expand this to include periodontal bone loss or endodontic treatments.
  • Pseudo-labeling Reliance: The strategy relies on an initial model to label "healthy" teeth in the Dentex dataset. Any errors in this initial detection phase could propagate through the final training.
  • Pose Estimation: The authors mentioned they have implemented heads for pose estimation and regression but have not yet detailed those results, suggesting a future direction for even more granular dental analysis (e.g., tooth angulation).

Summary updated

Abstract

Detecting dental diseases through panoramic X-rays images is a standard procedure for dentists. Normally, a dentist need to identify diseases and find the infected teeth. While numerous machine learning models adopting this two-step procedure have been developed, there has not been an end-to-end model that can identify teeth and their associated diseases at the same time. To fill the gap, we develop YOLOrtho, a unified framework for teeth enumeration and dental disease detection. We develop our model on Dentex Challenge 2023 data, which consists of three distinct types of annotated data. The first part is labeled with quadrant, and the second part is labeled with quadrant and enumeration and the third part is labeled with quadrant, enumeration and disease. To further improve detection, we make use of Tufts Dental public dataset. To fully utilize the data and learn both teeth detection and disease identification simultaneously, we formulate diseases as attributes attached to their corresponding teeth. Due to the nature of position relation in teeth enumeration, We replace convolution layer with CoordConv in our model to provide more position information for the model. We also adjust the model architecture and insert one more upsampling layer in FPN in favor of large object detection. Finally, we propose a post-process strategy for teeth layout that corrects teeth enumeration based on linear sum assignment. Results from experiments show that our model exceeds large Diffusion-based model.
BibTeX
@misc{mei2023yolortho,
  author = {Shenxiao Mei and Chenglong Ma and Feihong Shen and Huikai Wu},
  title = {{YOLOrtho -- A Unified Framework for Teeth Enumeration and Dental Disease Detection}},
  year = {2023},
  eprint = {2308.05967},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2308.05967},
}
Figure