CircleNet for Hip Landmark Detection

Hai Wu, Hongtao Xie, Chuanbin Liu, Zheng-Jun Zha, Jun Sun, Yongdong Zhang

CircleNet is a streamlined, anchor-free framework designed to detect anatomical landmarks in hip X-rays for diagnosing Developmental Dysplasia of the Hip (DDH). By predicting both a landmark's location and a corresponding radius—effectively treating landmarks as circles—the model captures essential geometric relationships and achieves state-of-the-art accuracy at high inference speeds.

Addressing the Challenges of DDH Diagnosis

Diagnosing DDH in infants and children relies on the "Tönnis method," which requires clinicians to identify six specific landmarks on a pelvic X-ray to measure joint displacement. However, automated detection is notoriously difficult because pediatric X-rays often suffer from low contrast, noise, and significant variations in bone morphology as children grow.

Anatomical landmarks (1-6) and diagnostic lines (Hilgenreiner and Perkin) used in the Tönnis method for DDH diagnosis.

Existing deep learning approaches usually fall into two camps: heatmap-based landmark detection or anchor-based object detection. Heatmap methods often treat landmarks as isolated points, ignoring the structural relationships between them (e.g., the distance between the left and right pelvic bones). Anchor-based methods are often computationally heavy and require complex post-processing like Non-Maximum Suppression (NMS). CircleNet aims to bridge these gaps with a simpler, "circle-based" representation that encodes anatomical constraints directly into the architecture.

Methodology: CircleNet and the LNL Block

The authors introduce two primary innovations to improve detection performance and efficiency:

1. CircleNet Framework

Built on a ResNet-50 backbone, CircleNet is an anchor-free system that predicts three specific outputs for each landmark:

  • Heatmap: To identify the central point of the landmark.
  • Local Offset: To compensate for precision lost during the image downsampling process.
  • Radius: This is the "secret sauce." For certain pairs of landmarks, the radius represents the distance between them. For the femoral heads (the "ball" of the hip joint), the radius defines the actual size of the bone head. This allows the model to "self-constrain" its predictions based on the known geometry of the human pelvis.

2. Local Non-Local (LNL) Block

Standard "Non-Local" blocks are great at capturing long-range dependencies but are computationally expensive. The LNL block optimizes this by cropping to the Region of Interest (ROI) using simple image processing to identify the pelvic region and ignore irrelevant edges. It also uses a bottleneck approach to reduce the number of channels processed, significantly lowering the parameter count compared to traditional layers.

The DDH Dataset

The researchers constructed and released a professional DDH Dataset, which is currently the largest of its kind. It contains 9,532 X-ray images collected from a Children’s Hospital between 2013 and 2019.

Sample X-rays from the DDH dataset illustrating the wide variation in bone morphology across different ages.

The dataset was annotated by 15 professional doctors and covers children aged 0.1 to 12 years, capturing various stages of bone development and providing a robust benchmark for pediatric orthopedic imaging.

Key Results and Insights

CircleNet significantly outperformed existing state-of-the-art (SOTA) methods across several metrics:

  • Accuracy: It achieved an average error of 4.79 pixels, a massive improvement over standard models like Faster R-CNN (6.65 pixels) and specialized medical models like SAC (31.11 pixels).
  • Robustness: CircleNet recorded zero missed detections (MD) on the test set, whereas many other high-performing models missed landmarks in up to 21 images.
  • Speed: The base CircleNet runs at 25.6 FPS, and the version with the LNL block runs at 22.7 FPS, making it viable for real-time clinical use.

By forcing the network to predict a radius, the authors essentially bake anatomical knowledge into the loss function. The network isn't just looking for a "point"; it's looking for a point that exists at a specific, mathematically consistent distance from its counterpart. Furthermore, the LNL block’s strategy of focusing on the ROI proves that global attention is more effective when it's focused on the area where landmarks actually concentrate.

Conclusion

CircleNet offers a robust, efficient solution for automated hip landmark detection. While future work could focus on reducing dependency on initial ROI cropping and broader clinical validation, the current results demonstrate a significant step forward in applying deep learning to pediatric orthopedic diagnostics.

Summary updated

Abstract

Landmark detection plays a critical role in diagnosis of Developmental Dysplasia of the Hip (DDH). Heatmap and anchor-based object detection techniques could obtain reasonable results. However, they have limitations in both robustness and precision given the complexities and inhomogeneity of hip X-ray images. In this paper, we propose a much simpler and more efficient framework called CircleNet to improve the accuracy of landmark detection by predicting landmark and corresponding radius. Using the CircleNet, we not only constrain the relationship between landmarks but also integrate landmark detection and object detection into an end-to-end framework. In order to capture the effective information of the long-range dependency of landmarks in the DDH image, here we propose a new context modeling framework, named the Local Non-Local (LNL) block. The LNL block has the benefits of both non-local block and lightweight computation. We construct a professional DDH dataset for the first time and evaluate our CircleNet on it. The dataset has the largest number of DDH X-ray images in the world to our knowledge. Our results show that the CircleNet can achieve the state-of-the-art results for landmark detection on the dataset with a large margin of 1.8 average pixels compared to current methods. The dataset and source code will be publicly available.
BibTeX
@inproceedings{wu2020circlenet,
  author = {Hai Wu and Hongtao Xie and Chuanbin Liu and Zheng-Jun Zha and Jun Sun and Yongdong Zhang},
  title = {{CircleNet for Hip Landmark Detection}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2020},
  doi = {10.1609/aaai.v34i07.6922},
}
Figure