Reducing the Human Effort in Developing PET-CT Registration

Teaghan O'Briain, Kyong Hwan Jin, Hongyoon Choi, Erika Chin, Magdalena Bazalova-Carter, Kwang Moo YiarXiv 2019 · arXiv

Abstract

Medical image registration for PET-CT scans is essential for longitudinal disease tracking but is often hampered by the intensive manual labor required to generate 3D ground-truth labels. We present a novel framework that utilizes "key curves" derived from sparse 2D annotations for evaluation and a self-supervised training loop with cross-visit semantic consistency. This approach achieves high-accuracy 3D alignment while significantly reducing the expert effort needed for model development and validation.

Introduction

PET-CT registration aligns scans taken at different time points, a process complicated by physiological changes such as weight loss or postural shifts. Traditional deep learning methods for this task require massive amounts of perfectly aligned 3D volumes, which are difficult and time-consuming for clinicians to produce. This "data bottleneck" has limited the adoption of automated registration tools in clinical workflows.

Methodology

The proposed method addresses the data bottleneck through two primary innovations: key-curve evaluation and weakly supervised training.

Visualizing the registration process: Source PET overlaid on Target CT, Target PET on Target CT (ideal), and Aligned PET on Target CT.

Key-Curves for Evaluation

Instead of full 3D volume alignment, experts provide corresponding points on several 2D slices. These points are fitted to a second-order polynomial to create a 3D "key curve." This method is more intuitive for humans and provides a robust metric for measuring misalignment without requiring dense point-to-point correspondence.

The key-curve evaluation metric: fitting second-order polynomials to sparse 2D annotations to measure 3D misalignment.

Weakly Supervised Training and Semantic Consistency

The training process is entirely data-driven, utilizing self-supervision where the network learns to undo synthetic 3D deformations. To handle real-world variations between patient visits, the authors employ Linear Centered Kernel Alignment (LCKA). This technique enforces semantic consistency in the network's feature maps across different visits, ensuring the model focuses on structural alignment rather than transient biological changes.

Results and Discussion

The method was evaluated on the QIN-HEADNECK dataset. The full proposed method reduced the Root Mean Squared Error (RMSE) of the key curves from 29.25 mm (unaligned) to 13.41 mm. Ablation studies confirmed that the LCKA component is crucial, as its removal increased the error to 15.89 mm. Qualitative analysis showed that the model successfully aligns complex structures like the spine and ribs, which are typically challenging for automated systems.

Conclusion

By decoupling training from human-intensive labeling and introducing a curve-based evaluation metric, this research significantly lowers the barrier to developing high-performance PET-CT registration models. Future work will explore making the key-curve metric differentiable to allow for direct optimization during training.

Summary updated

Abstract

We aim to reduce the tedious nature of developing and evaluating methods for aligning PET-CT scans from multiple patient visits. Current methods for registration rely on correspondences that are created manually by medical experts with 3D manipulation, or assisted alignments done by utilizing mutual information across CT scans that may not be consistent when transferred to the PET images. Instead, we propose to label multiple key points across several 2D slices, which we then fit a key curve to. This removes the need for creating manual alignments in 3D and makes the labelling process easier. We use these key curves to define an error metric for the alignments that can be computed efficiently. While our metric is non-differentiable, we further show that we can utilize it during the training of our deep model via a novel method. Specifically, instead of relying on detailed geometric labels -- e.g., manual 3D alignments -- we use synthetically generated deformations of real data. To incorporate robustness to changes that occur between visits other than geometric changes, we enforce consistency across visits in the deep network's internal representations. We demonstrate the potential of our method via qualitative and quantitative experiments.
BibTeX
@misc{obriain2019reducing,
  author = {Teaghan O'Briain and Kyong Hwan Jin and Hongyoon Choi and Erika Chin and Magdalena Bazalova-Carter and Kwang Moo Yi},
  title = {{Reducing the Human Effort in Developing PET-CT Registration}},
  year = {2019},
  eprint = {1911.10657},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1911.10657},
}
Figure