Multistage Probabilistic Approach for the Localization of Cephalometric Landmarks

Hyuk Jin Kwon, Hyung Il Koo, Jaewoo Park, Nam Ik Cho

Introduction

In the fields of orthodontics and maxillofacial surgery, cephalometric analysis is a fundamental diagnostic tool. It involves identifying specific anatomical landmarks on lateral skull X-rays to assess skeletal and dental relationships. Traditionally, these landmarks are identified manually by clinicians, a process that is not only time-consuming but also susceptible to significant inter-examiner variation.

While deep learning has significantly advanced automated landmark detection, two primary challenges persist. First, the standard "heatmap regression" approach typically relies on an "argmax" operation to select the highest-intensity pixel as the landmark. This operation is non-differentiable, which complicates end-to-end training and often requires the use of artificial ground-truth heatmaps. Second, bilateral structures like the mandible (lower jaw) present a unique challenge in 2D projections; natural asymmetry or slight head rotations cause left and right structures to overlap imperfectly, making landmarks such as the gonion difficult to localize accurately.

The Multistage Framework

To address these challenges, this research proposes a three-stage "Global-to-Local" pipeline designed to move from broad anatomical context to fine-grained textural details.

Overview of the proposed multistage framework, illustrating the progression from global anatomical context to local refinement and specialized mandibular filtering.

1. Global Stage

The process begins with a convolutional neural network (CNN) based on the DeepLabv3 architecture. This network processes a downsampled version of the entire X-ray to capture the spatial relationships between all 19 landmarks simultaneously. By analyzing the global hard and soft tissue characteristics, the model establishes a robust initial estimate for each point.

2. Local Stage

Building on the global estimates, the system crops high-resolution patches around each predicted landmark. Individual CNNs are then deployed for each specific landmark, allowing the model to focus on the unique local anatomy and fine-grained textures that define the exact point of interest.

3. Refinement Stage

For particularly challenging mandibular landmarks, such as the gonion and articulare, the authors introduce a specialized refinement step. Interestingly, they found that a constrained linear estimator outperformed complex deep neural networks in this final stage. Given the relatively small size of medical datasets, the linear approach proved more robust against overfitting and provided better generalization for these bilateral structures.

Probabilistic Expectation vs. Argmax

A core innovation of this framework is the shift from deterministic to probabilistic localization. Instead of using the standard argmax to find the brightest pixel in a heatmap, the model treats the network's output as a probability density function. By calculating the mathematical expectation (the weighted average position) of the map, the entire pipeline becomes differentiable. This allows for end-to-end training and enables the model to output sub-pixel coordinates, enhancing precision beyond the resolution of the input grid.

Furthermore, this probabilistic approach allows for the visualization of "standard deviational ellipses." These ellipses serve as built-in confidence metrics: a tight ellipse indicates high model certainty, while a wider ellipse signals ambiguity, providing valuable feedback for clinical review.

Results and Clinical Validation

The proposed method was evaluated using the ISBI2015 dataset, a gold-standard benchmark containing 400 high-resolution lateral cephalograms. The model achieved state-of-the-art performance, reducing the Mean Radial Error (MRE) to 1.12 mm on the first test set and 1.41 mm on the second.

At the strict clinical success threshold of 2.0 mm, the model achieved a 77.16% Successful Detection Rate (SDR), outperforming previous benchmarks like CephaNN. Beyond raw coordinate accuracy, the system was validated against eight standard clinical measurement methods (such as the ANB angle). The results demonstrated that the automated system's measurements are comparable to, or in some cases more consistent than, those provided by experienced orthodontists.

Conclusion

By combining global context, local refinement, and a differentiable probabilistic framework, this multistage approach offers a robust solution for automated cephalometric landmarking. The inclusion of specialized linear filters for the mandible highlights the importance of balancing model complexity with dataset size. Future work will focus on addressing labeling inconsistencies in soft tissue landmarks and expanding the refinement stage to further improve accuracy across all anatomical points.

Summary updated

Abstract

The accurate and reproducible localization of cephalometric landmarks is an important procedure for treatment planning and clinical practice in orthodontics and maxillofacial surgery. In this paper, we propose a new multistage cephalometric landmark localization method that exploits local appearances and global characteristics simultaneously. To be precise, a convolutional neural network(CNN) is trained by minimizing the sum of all landmark errors. Since landmarks are considered simultaneously, global hard/soft tissue characteristics, as well as landmark relations, can be reflected in this stage. Then, we exploit local appearances by using high-resolution cropped images. In this second stage, we train CNNs for individual landmarks, respectively. Finally, we improve the localization performance of cephalometric landmarks of the mandible with linear estimators. Experiments on ISBI2015 dataset have shown that the proposed method outperforms conventional methods. Also, the proposed method allows us to evaluate confidence (e.g., standard deviational ellipses) due to its probabilistic formulation.
BibTeX
@article{kwon2021multistage,
  author = {Hyuk Jin Kwon and Hyung Il Koo and Jaewoo Park and Nam Ik Cho},
  title = {{Multistage Probabilistic Approach for the Localization of Cephalometric Landmarks}},
  journal = {IEEE Access},
  year = {2021},
  doi = {10.1109/access.2021.3052460},
}
Figure