Dental caries detection using a semi-supervised learning approach

Adnan Qayyum, Ahsen Tahir, Muhammad Atif Butt, Alexander Maniangat Luke, Hasan Abbas, Junaid Qadir, Kamran Arshad, Khaled Assaleh, Muhammad Ali Imran, Qammer H. AbbasiScientific 2023 · DOI

TL;DR

This paper introduces a novel semi-supervised learning approach for detecting dental caries from X-ray images, significantly reducing the need for extensive manual annotation. By employing a student-teacher model and a unique centroid cropping technique, they achieve competitive performance with far less labeled data, making advanced AI diagnostics more accessible in clinical settings.

What Problem Does This Paper Address?

Diagnosing dental caries, or tooth decay, early is crucial for preventing invasive treatments and reducing healthcare costs. Dental radiography is a primary tool for this, but manually analyzing these images is challenging, especially for early-stage or proximal caries. While deep learning (DL) models show promise, they typically require vast amounts of meticulously labeled data, which is expensive, time-consuming, and often scarce in real-world clinical environments. This paper tackles this data bottleneck by developing a semi-supervised learning framework that can effectively learn from a small set of labeled images and a much larger pool of unlabeled ones.

Methods

The core of the proposed solution is a student-teacher self-training framework.

  1. Teacher Model Training: A "teacher" model is first trained in a fully supervised manner using a small, carefully curated set of labeled dental X-ray images.
  2. Pseudo-label Generation: This trained teacher model then infers "pseudo-labels" for a large collection of unlabeled images. These pseudo-labels are essentially the teacher's best guess for the caries regions in the unlabeled data.
  3. Student Model Training: A "student" model is then trained using a combination of the original labeled data and the pseudo-labeled data. This allows the student model to learn from a much larger, albeit partially noisy, dataset.

A key innovation is the Centroid Cropping and Data Sampling (CCS) method. Instead of processing entire high-resolution X-ray images, CCS dynamically crops the region of interest around the detected caries. This significantly reduces the computational load and addresses class imbalance issues (where caries pixels are much fewer than background pixels) inherent in dental radiographs. The cropped images and their corresponding labels (real or pseudo) are then used for training both the teacher and student models. Various data augmentation techniques are also applied to the cropped images to further enhance the student model's robustness.

Datasets

The authors introduce a new benchmark dataset called the Dental Caries Detection Dataset (DCD²).

  • It comprises a total of 229 dental radiographs.
  • Of these, 141 images are annotated (labeled) and 88 are unlabelled.
  • The dataset includes a mix of male and female dental scans.
  • The labeled images were used for training fully supervised models and the teacher model, while both labeled and unlabeled images were utilized in the semi-supervised learning approach.

Key Insights and Ideas

  • Semi-supervised learning is viable for dental caries detection: The paper demonstrates that effective caries detection can be achieved even with a very limited number of labeled images, provided a robust semi-supervised strategy is employed.
  • Centroid Cropping (CCS) is a game-changer: This technique dramatically improves computational efficiency and performance by focusing on relevant regions and mitigating class imbalance. It's highlighted as a key factor in achieving better results compared to standard self-training.
  • Teacher-student models learn effectively from pseudo-labels: The teacher model, even when trained on a small labeled set, can generate high-quality pseudo-labels that significantly boost the performance of the student model.
  • Generalizability across student architectures: The proposed semi-supervised framework shows good generalization capabilities, performing well with different student model architectures, indicating its flexibility.

Key Results

  • The proposed CCS-based self-training approach achieved a performance improvement of approximately 6% in average pixel accuracy and 3% in mean intersection over union (mIoU) compared to standard self-supervised learning methods.
  • When using only 20 labeled images for the teacher model, the CCS-based method achieved an mIoU of 56.61%, significantly outperforming standard self-training (45.07%).
  • The optimal number of labeled images for the teacher model was found to be 40, yielding an mIoU of 56.49% with CCS.
  • The study also showed that increasing the number of unlabeled (pseudo-labeled) samples for the student model generally improved performance, up to a certain point.
  • Qualitative results (Figure 6) show visually accurate segmentation of caries regions by the proposed method.

Limitations and Future Work

  • Overfitting with more labeled data: The authors observed that increasing the number of labeled samples beyond a certain point (e.g., 120 images) led to overfitting, with performance deteriorating. This suggests a need for careful data selection or more advanced regularization techniques.
  • Future work: The authors aim to develop a more diverse and larger database for dental caries detection, which could further enhance the robustness and generalizability of their methods.

Summary updated

Abstract

Early diagnosis of dental caries progression can prevent invasive treatment and enable preventive treatment. In this regard, dental radiography is a widely used tool to capture dental visuals that are used for the detection and diagnosis of caries. Different deep learning (DL) techniques have been used to automatically analyse dental images for caries detection. However, most of these techniques require large-scale annotated data to train DL models. On the other hand, in clinical settings, such medical images are scarcely available and annotations are costly and time-consuming. To this end, we present an efficient self-training-based method for caries detection and segmentation that leverages a small set of labelled images for training the teacher model and a large collection of unlabelled images for training the student model. We also propose to use centroid cropped images of the caries region and different augmentation techniques for the training of self-supervised models that provide computational and performance gains as compared to fully supervised learning and standard self-supervised learning methods. We present a fully labelled dental radiographic dataset of 141 images that are used for the evaluation of baseline and proposed models. Our proposed self-supervised learning strategy has provided performance improvement of approximately 6% and 3% in terms of average pixel accuracy and mean intersection over union, respectively as compared to standard self-supervised learning. Data and code will be made available to facilitate future research.
BibTeX
@inproceedings{qayyum2023dental,
  author = {Adnan Qayyum and Ahsen Tahir and Muhammad Atif Butt and Alexander Maniangat Luke and Hasan Abbas and Junaid Qadir and Kamran Arshad and Khaled Assaleh and Muhammad Ali Imran and Qammer H. Abbasi},
  title = {{Dental caries detection using a semi-supervised learning approach}},
  booktitle = {Scientific},
  year = {2023},
  doi = {10.1038/s41598-023-27808-9},
}
Figure