Encoding Matching Criteria for Cross-domain Deformable Image Registration

Zhuoyuan Wang, Haiqiao Wang, Yi WangarXiv 2024 · DOI · arXiv

Introduction

Deformable image registration (DIR) is a fundamental task in medical imaging, essential for aligning scans to account for anatomical variations or temporal changes. While traditional iterative algorithms like Symmetric Normalization (SyN) offer high adaptability across diverse anatomical domains, their computational intensity makes them slow for real-time clinical use. Conversely, deep learning (DL) models provide near-instantaneous inference but often suffer from "domain brittleness"—a significant drop in performance when applied to anatomical regions or modalities different from their training set.

This research addresses this gap by proposing a framework that explicitly encodes matching criteria, mimicking the robust logic of traditional algorithms within a high-speed neural network architecture.

Methodology: Registration-Oriented Dual Encoders

The core innovation lies in a dual-branch encoder designed to capture both general medical features and structural self-similarity.

The proposed registration framework architecture, highlighting the dual-encoder design (Encoder-G and Encoder-S) and the hierarchical decoder.

Encoder-G: General Feature Extraction

The General Feature Encoder (Encoder-G) utilizes a pre-trained "MedicalNet" (ResNet50) to extract broad anatomical features. To ensure these features remain comprehensive and not overfit to specific training textures, the authors employ a Mutual Information (MI) loss function. This encourages the network to preserve maximal information from the input images across different domains.

Encoder-S: Structural Feature Extraction

The Structural Feature Encoder (Encoder-S) introduces a novel Structural Embedding Module (SEM). Unlike standard convolutions that focus on pixel intensities, the SEM calculates local self-similarity using cosine similarity within voxel neighborhoods. This approach mimics classical registration logic, which prioritizes geometric patterns over raw intensity, making the model inherently more robust to contrast variations.

One-Shot Fine-Tuning Strategy

To bridge the domain gap during inference, the framework employs a "one-shot" strategy. When presented with a new anatomical domain (e.g., moving from brain to abdominal scans), the general encoder is frozen, while the structural encoder is allowed to fine-tune on the specific image pair for a limited number of iterations (typically 5 to 20). This brief "handshake" period allows the model to adapt its matching logic to the new data characteristics before performing the final registration.

Experimental Evaluation

The model was rigorously tested on three public MRI datasets: LPBA40 (Brain), AbdMR (Abdomen), and Cardiac. These datasets provide a diverse range of anatomical structures and imaging properties to evaluate cross-domain generalization.

Key Results

The proposed method demonstrated superior performance in both single-domain and cross-domain scenarios:

  • Single-Domain Performance: When trained and tested on the same anatomy, the model outperformed state-of-the-art (SOTA) methods like VoxelMorph and TransMorph, achieving a 3.4% to 11.5% improvement in Dice Similarity Coefficient (DSC).
  • Cross-Domain Robustness: In challenging cross-domain tasks (e.g., applying an abdomen-trained model to brain data), the proposed method with 20-iteration one-shot tuning surpassed the traditional SyN algorithm across all tested scenarios.
Cross-domain registration results comparing the proposed models (Model_A, Model_B) against the traditional SyN algorithm for brain and abdomen MRI.

Computational Efficiency

While the one-shot adaptation introduces a slight overhead compared to pure DL inference, it remains highly efficient. A 5-iteration adaptation takes approximately 17.3 seconds per volume pair, which is significantly faster than the 114.7 seconds required by the traditional SyN method, while delivering higher accuracy.

Conclusion

By explicitly modeling matching criteria through a dual-encoder architecture and a one-shot adaptation strategy, this framework successfully combines the speed of deep learning with the robustness of traditional registration methods. Future work will focus on further optimizing the adaptation speed and exploring the model's performance across other imaging modalities such as CT and Ultrasound.

Summary updated

BibTeX
@misc{wang2024encoding,
  author = {Zhuoyuan Wang and Haiqiao Wang and Yi Wang},
  title = {{Encoding Matching Criteria for Cross-domain Deformable Image Registration}},
  year = {2024},
  eprint = {2406.12350},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2406.12350},
}
Figure