Fully Convolutional Network for Consistent Voxel-Wise Correspondence

Yungeng Zhang, Yuru Pei, Yuke Guo, Gengyu Ma, Tianmin Xu, Hongbin ZhaAAAI 2020 · DOI

Abstract

This paper presents an unsupervised 3D medical image registration framework using a Fully Convolutional Network (FCN) that enforces cycle consistency and invertibility. By learning bidirectional mappings between input volumes and a shared template, the model achieves state-of-the-art voxel-wise correspondence. The approach significantly reduces non-physical distortions, such as topology folding, without requiring manual labels, enabling rapid and anatomically plausible registration for clinical applications.

Introduction

In medical imaging, registration is the process of establishing dense, voxel-wise correspondence between 3D scans, such as pre- and post-treatment images. This is essential for tracking disease progression and surgical planning. Traditional registration methods rely on iterative optimization, which is computationally expensive and prone to local minima. While deep learning approaches offer significant speedups, they often struggle with data scarcity (the need for manual landmarks) and physical implausibility, frequently producing non-invertible mappings that result in "topology folding."

Methodology

The proposed framework utilizes a 3D U-Net architecture to perform template-based bidirectional mapping. Unlike standard unidirectional models, this network predicts both a forward displacement vector field (DVF), $\phi_f$, and a backward field, $\phi_b$, relative to a shared template grid.

Overview of the proposed unsupervised training framework showing the bidirectional DVF learning and consistency constraints.

Key Technical Components

  • Combinational Inverse Constraints: The core innovation is a loss function that enforces invertibility. It ensures that the composition of forward and backward mappings results in an identity transformation. This is extended to "cycle consistency" across triplets of volumes to ensure global registration consistency.
  • Unsupervised Learning via STN: A Spatial Transformer Network (STN) is used to warp images during training. The network learns by minimizing the appearance difference between warped images and the template, eliminating the need for ground-truth labels.
  • Structure-Aware Constraints: For tasks requiring high precision in specific areas (e.g., the skull base), an optional loss term penalizes inconsistencies within defined "Structures of Interest" (SOI).

Experimental Setup

The model was validated using a clinical dataset of 400 craniofacial Cone-Beam CT (CBCT) images from orthodontic patients. To establish a ground truth for accuracy testing, a synthetic dataset was created by applying random B-spline deformations to a template. Evaluation metrics included Mean Squared Distance (MSD) for accuracy and Dice Similarity Coefficients (DSC) for label propagation across seven anatomical structures, including the maxilla and mandible.

Results and Discussion

The FCN-based approach demonstrated significant improvements in both efficiency and physical validity. Once trained, the network registers a pair of 3D volumes in approximately 0.17 seconds, a massive improvement over traditional iterative methods.

Qualitative comparison of registration results and displacement fields between the proposed method and baseline algorithms like SyN and VoxelMorph.

Performance Highlights

  • Accuracy: The model achieved an MSD of roughly 0.20mm on synthetic data, indicating high precision.
  • Robustness: In label propagation tests, the model matched or outperformed state-of-the-art tools such as SyN and VoxelMorph.
  • Topology Preservation: The inverse constraints were highly effective; the number of voxels with negative Jacobian determinants (indicating non-physical folding) was reduced by over 99% compared to standard convolutional networks.

Conclusion

By shifting the registration paradigm toward bidirectional template mapping and enforcing cycle consistency, this work provides a fast, unsupervised solution for 3D medical image registration. While the current implementation is limited by memory constraints to $128^3$ resolutions and relies on a shared template, it represents a major step toward physically plausible and computationally efficient voxel-wise correspondence in clinical workflows.

Summary updated

BibTeX
@inproceedings{zhang2020fully,
  author = {Yungeng Zhang and Yuru Pei and Yuke Guo and Gengyu Ma and Tianmin Xu and Hongbin Zha},
  title = {{Fully Convolutional Network for Consistent Voxel-Wise Correspondence}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2020},
  doi = {10.1609/aaai.v34i07.6992},
}
Figure