Tetrahedron-Net for Medical Image Registration

Jinhai Xiang, Shuai Guo, Qianru Han, Dantong Shi, Xinwei He, Xiang BaiarXiv 2025 · DOI · arXiv

Abstract

Medical image registration (MIR) is a fundamental task in clinical workflows, enabling the alignment of disparate scans into a common coordinate system. While deep learning models, particularly U-Net variants, have accelerated this process, single-decoder architectures often struggle with high-precision alignment of complex anatomical structures. This paper introduces Tetrahedron-Net, a novel architectural framework that utilizes a dual-decoder strategy to achieve coarse-to-fine refinement. By integrating a second decoder that interacts with both the encoder and the primary decoder, Tetrahedron-Net significantly enhances registration accuracy and transformation regularity across multiple benchmarks.

Introduction

Accurate medical image registration is essential for longitudinal studies, surgical planning, and multi-modal data fusion. Traditional iterative optimization methods, while accurate, are computationally expensive. Deep learning has shifted the paradigm toward fast, learning-based regression. However, standard U-Net architectures—consisting of a single encoder and decoder—may not fully exploit multi-scale feature interactions necessary for capturing intricate deformations.

The proposed Tetrahedron-Net addresses this by appending a second decoder to the standard U-Net backbone. This "Tetrahedron" structure facilitates a hierarchical refinement process, where the first decoder generates a coarse alignment that is subsequently polished by the second decoder using high-resolution features from the encoder.

Methodology

The core of Tetrahedron-Net is its tripartite structure: an Encoder (Enc), a first Decoder (Dec1), and a second Decoder (Dec2).

  1. Encoder (Enc): Extracts hierarchical features from the concatenated moving and fixed images.
  2. First Decoder (Dec1): Operates as a standard decoder with skip connections from the encoder to produce an initial, coarse registration field.
  3. Second Decoder (Dec2): This component receives inputs from both the Encoder and Dec1. This dual-input stream allows Dec2 to treat the output of Dec1 as a prior, refining it with the detailed spatial information preserved in the encoder’s skip connections.
Figure 2: The Tetrahedron-Net architecture featuring the dual-decoder (Dec1 and Dec2) structure for coarse-to-fine registration refinement.

The authors evaluated several internal configurations for Dec2, including UNet++, UNet3+, and DenseUNet. The DenseUNet variant, characterized by dense feature propagation, demonstrated superior stability and performance. This architecture is backbone-agnostic and can be integrated into existing state-of-the-art models such as VoxelMorph and TransMorph.

Experiments and Results

The framework was validated on three structural brain MRI datasets: LPBA40, IXI, and OASIS. Standard preprocessing, including skull stripping and affine alignment via FreeSurfer, was applied to all volumes.

Quantitative Performance

Tetrahedron-Net consistently outperformed baseline models. On the LPBA40 dataset, the DenseUNet variant of Tetrahedron-Net improved the Dice Similarity Coefficient (DSC) by 2.3% over VoxelMorph and 0.6% over TransMorph. On the IXI dataset, the model achieved a state-of-the-art DSC of 0.765.

Figure 6: Training loss (a) and Dice scores (b) over 500 epochs, illustrating the superior convergence and accuracy of the U_DenseUNet variant.

Transformation Regularity

Beyond accuracy, Tetrahedron-Net produced more physically plausible deformations. Analysis of the Jacobian determinants revealed a significant reduction in non-positive values, indicating smoother transformations with fewer instances of unrealistic tissue folding or "tearing."

Conclusion

Tetrahedron-Net represents a significant advancement in medical image registration by demonstrating that a dual-decoder approach can effectively bridge the gap between coarse alignment and fine-grained anatomical precision. The architecture's ability to enhance diverse backbones—from convolutional to transformer-based—suggests broad applicability. Future research will explore the extension of the Tetrahedron design to other dense prediction tasks, such as medical image segmentation and 2D computer vision applications.

Summary updated

Abstract

Medical image registration plays a vital role in medical image processing. Extracting expressive representations for medical images is crucial for improving the registration quality. One common practice for this end is constructing a convolutional backbone to enable interactions with skip connections among feature extraction layers. The de facto structure, U-Net-like networks, has attempted to design skip connections such as nested or full-scale ones to connect one single encoder and one single decoder to improve its representation capacity. Despite being effective, it still does not fully explore interactions with a single encoder and decoder architectures. In this paper, we embrace this observation and introduce a simple yet effective alternative strategy to enhance the representations for registrations by appending one additional decoder. The new decoder is designed to interact with both the original encoder and decoder. In this way, it not only reuses feature presentation from corresponding layers in the encoder but also interacts with the original decoder to corporately give more accurate registration results. The new architecture is concise yet generalized, with only one encoder and two decoders forming a ``Tetrahedron'' structure, thereby dubbed Tetrahedron-Net. Three instantiations of Tetrahedron-Net are further constructed regarding the different structures of the appended decoder. Our extensive experiments prove that superior performance can be obtained on several representative benchmarks of medical image registration. Finally, such a ``Tetrahedron'' design can also be easily integrated into popular U-Net-like architectures including VoxelMorph, ViT-V-Net, and TransMorph, leading to consistent performance gains.
BibTeX
@misc{xiang2025tetrahedron,
  author = {Jinhai Xiang and Shuai Guo and Qianru Han and Dantong Shi and Xinwei He and Xiang Bai},
  title = {{Tetrahedron-Net for Medical Image Registration}},
  year = {2025},
  eprint = {2505.04380},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2505.04380},
}
Figure