A Multiclass Classification Model for Tooth Removal Procedures

W.m. de Graaf, T.c.t. van Riet, Jan de Lange, Jens KoberJournal of Dental Research 2022 · DOI

TL;DR

This paper introduces a machine learning model to classify tooth removal procedures using force, torque, and movement data. By leveraging a novel robotic setup and feature engineering, they've taken a significant first step towards understanding these complex procedures, with potential applications in dental education and clinical guidelines.

What Problem Does This Paper Address?

Tooth removal, despite being one of the oldest and most common surgical procedures, remains surprisingly under-researched. The difficulty in collecting reliable, detailed data on the subtle forces and movements involved has created a knowledge gap. Existing descriptions in textbooks haven't significantly evolved, and scientific attempts to understand the nuances of extraction are rare and often focus on limited aspects like extraction forces. This lack of deep understanding hinders the development of evidence-based educational materials and modern clinical guidelines.

Methods

The researchers developed a sophisticated measurement setup using a compliant robot arm and a 6-axis force/torque sensor to capture high-resolution data (position, orientation, forces, torques) during tooth removal. They used fresh-frozen cadavers to mimic clinical conditions. Key to their approach was feature engineering, where they transformed raw sensor data into clinically interpretable variables (e.g., peak forces, rotational velocities). They then employed feature selection using logistic regression with L2 regularization to identify the most informative features, reducing the initial 75 to 33. Finally, a Gaussian Naive Bayes (GNB) classifier was trained on this reduced feature set to predict the type of tooth being removed. A stratified 4-fold cross-validation was used to evaluate the model's performance.

Datasets

The study utilized data from 110 successful tooth removal experiments performed on 7 fresh-frozen cadavers. This dataset, collected using their custom robotic setup, represents a novel benchmark for analyzing tooth removal procedures. The data captured 13-dimensional time series for each procedure.

Key Insights and Ideas

  • The power of comprehensive data: Capturing not just forces but also precise movements and torques provides a much richer picture of tooth extraction dynamics than previously possible.
  • Feature engineering is crucial: Transforming raw sensor data into clinically meaningful features (like "sum of torques" or "rotational velocity around the Y-axis") was essential for the model's success.
  • Sum of forces/torques matters most: The study found that the total force and torque across all axes, rather than forces in individual directions, were the most descriptive for classification.
  • Rotational dynamics are key: Rotations around the Y-axis (buccoversion/palatoversion) and Z-axis (longitudinal) were frequently selected features, aligning with clinical intuition about how teeth are manipulated.
  • Ex vivo limitations: While fresh-frozen cadavers are a good proxy, the authors acknowledge that freezing might alter biomechanical properties, a factor to consider when interpreting results.

Key Results

The developed multiclass classification model achieved an average accuracy of 86% on the training set and 54% on the unseen test set. Importantly, the model correctly predicted the upper or lower jaw in 95% of experiments. Furthermore, it predicted the correct tooth class or a neighboring class in 88% of cases. This indicates a reasonable ability to classify tooth removal procedures even with a relatively small dataset and inherent variability.

Limitations and Future Work

The authors acknowledge several limitations:

  • Small dataset size: The 110 experiments are considered small, limiting the incorporation of additional metadata like periodontal health or surgeon experience.
  • Ex vivo data: The use of fresh-frozen cadavers, while practical, may not perfectly replicate in vivo biomechanics.
  • Class definition: The chosen tooth classes might have overlapping removal strategies, potentially impacting model performance.

Future work suggested includes:

  • Larger datasets: Incorporating more data and clinical metadata to improve model generalizability and performance.
  • In vivo data collection: Exploring ways to gather similar data in actual clinical settings.
  • Automated class selection: Investigating clustering techniques to let the model define optimal classes.
  • Simplified training tools: Developing simpler, force-feedback-based training setups for dental students, informed by the identified key features.
  • Predicting extraction complexity: Using metadata to develop models that predict the difficulty of a tooth extraction, aiding clinical decision-making.

Summary updated

Abstract

Surprisingly little is known about tooth removal procedures. This might be due to the difficulty of gaining reliable data on these procedures. To improve our understanding of these procedures, machine learning techniques were used to design a multiclass classification model of tooth removal based on force, torque, and movement data recorded during tooth removal. A measurement setup consisting of, among others, robot technology was used to gather high-quality data on forces, torques, and movement in clinically relevant dimensions. Fresh-frozen cadavers were used to match the clinical situation as closely as possible. Clinically interpretable variables or "features" were engineered and feature selection took place to process the data. A Gaussian naive Bayes model was trained to classify tooth removal procedures. Data of 110 successful tooth removal experiments were available to train the model. Out of 75 clinically designed features, 33 were selected for the classification model. The overall accuracy of the classification model in 4 random subsamples of data was 86% in the training set and 54% in the test set. In 95% and 88%, respectively, the model correctly classified the (upper or lower) jaw and either the right class or a class of neighboring teeth. This article discusses the design and performance of a multiclass classification model for tooth removal. Despite the relatively small data set, the quality of the data was sufficient to develop a first model with reasonable performance. The results of the feature engineering, selection process, and the classification model itself can be considered a strong first step toward a better understanding of these complex procedures. It has the potential to aid in the development of evidence-based educational material and clinical guidelines in the near future.
BibTeX
@article{graaf2022multiclass,
  author = {W.M. de Graaf and T.C.T. van Riet and Jan de Lange and Jens Kober},
  title = {{A Multiclass Classification Model for Tooth Removal Procedures}},
  journal = {Journal of Dental Research},
  year = {2022},
  doi = {10.1177/00220345221117745},
}
Figure