LADDA: Latent Diffusion-based Domain-adaptive Feature Disentangling for Unsupervised Multi-modal Medical Image Registration

Peng Yuan, Jianmin Dong, Wei Zhao, Fei Lyu, Cheng Xue, Yudong Zhang, Chunfeng Yang, Zhan Wu, Zhiqiang Gao, Tianling Lyu, Jean-Louis Coatrieux, Yang ChenIEEE JBHI 2025 · DOI

TL;DR

This paper introduces LADDA, a novel framework for unsupervised multi-modal medical image registration that tackles the challenge of disentangling anatomical content from modality-specific style information. By leveraging Latent Diffusion Models for anatomical priors and a novel Domain-Adaptive Feature Disentangling module, LADDA achieves superior registration accuracy and robustness, particularly in complex clinical scenarios.

What Problem Does This Paper Address?

Accurate alignment of medical images from different modalities (like MRI and CT) is crucial for diagnosis and treatment planning. However, this process is notoriously difficult due to several factors:

  • Appearance Differences: Images from different scanners or at different times can have vastly different intensity distributions and textures, even if they represent the same anatomy.
  • Morphological Differences: Patient movement, breathing, and physiological changes can cause anatomical structures to deform between scans.
  • Entangled Information: These appearance and morphological variations lead to "entanglement" where anatomical content (what the structure is) is mixed with style information (how it looks). This entanglement severely limits the performance of existing registration methods.

The paper aims to overcome these challenges by explicitly disentangling content and style information to achieve more precise and robust multi-modal image registration, especially in unsupervised settings where ground-truth deformations are unavailable.

Methods

LADDA is a multi-component framework designed to address the disentanglement problem:

  • Latent Diffusion Model-based Latent Representation Extraction (LDM-LRE): This module uses a pre-trained Latent Diffusion Model (LDM) to extract reliable "anatomical priors." These priors act as a strong contextual guide for the subsequent registration process, helping to capture the underlying structure even with modality differences.
  • Domain-Adaptive Feature Disentangling (DAFD): This is the core innovation. DAFD disentangles image features into two distinct representations: "content" (anatomical structure) and "style" (modality-specific appearance). This forces the network to focus on the anatomical information, reducing the interference from style variations. It employs a dual-stream architecture with shared weights for content and style encoders.
  • Neighborhood-Preserving Hashing (NPH): To efficiently integrate multi-scale content information and maintain structural consistency across modalities, NPH is used. It approximates attention computation by preserving local neighborhood relationships, reducing computational complexity compared to standard self-attention.
  • Unilateral-Query-Frozen Attention (UQFA): This module enhances the coupling between the upstream anatomical priors (from LDM) and the downstream disentangled content features. It uses a unique query-key matching mechanism to merge multi-domain representations, improving the recovery of fine details and textures.

The overall framework combines these modules within a dual-stream encoder-decoder architecture, trained in an unsupervised manner using a combination of similarity, smoothness, and disentanglement losses.

Datasets

The authors evaluated LADDA on several large-scale, multi-center datasets:

  • MR-to-CT Abdominal Dataset: An in-house dataset of paired CT and MRI abdominal images.
  • MR-to-CT Pelvic Dataset: A dataset of paired preoperative MRI and intraoperative CT from Beijing People's Hospital.
  • CT-to-CBCT Lung Dataset: Preoperative CT and intraoperative CBCT lung biopsy cases from Beijing Chaoyang Hospital.
  • Learn2Reg MICCAI Challenge (OncoReg dataset): Used for evaluating out-of-distribution (OOD) generalization. This dataset features large respiratory deformations and boundary changes.

Key Insights and Ideas

  • LDMs as Anatomical Priors: Using pre-trained Latent Diffusion Models to extract anatomical priors is a powerful way to guide multi-modal registration, providing a robust starting point that is less susceptible to modality-specific variations.
  • Explicit Content-Style Disentanglement is Key: The DAFD module's success highlights that directly addressing the entanglement of anatomical content and modality style is crucial for improving registration accuracy, especially in challenging multi-modal scenarios.
  • Efficiency through NPH: Neighborhood-Preserving Hashing offers a computationally efficient way to capture multi-scale structural information, making the model more practical for real-world applications.
  • UQFA for Fine Detail Recovery: The Unilateral-Query-Frozen Attention module effectively bridges the gap between low-frequency structural information and high-frequency textural details, leading to more refined registration results.

Key Results

LADDA demonstrated superior performance across various metrics and datasets:

  • Quantitative Improvements: LADDA consistently outperformed state-of-the-art methods in terms of Dice Similarity Coefficient (DSC), Hausdorff Distance (HD95), Average Symmetric Surface Distance (ASSD), and Target Registration Error (TRE) on abdominal, pelvic, and lung datasets. For instance, on the MR-to-CT abdominal dataset, it achieved a DSC of 92.5±1.56, outperforming other methods.
  • Robustness and Generalization: LADDA showed strong generalization capabilities, performing well on out-of-distribution (OOD) data from the Learn2Reg MICCAI challenge, achieving a significant improvement in DSC compared to initial misaligned images and the OTMorph method.
  • Topological Consistency: The method achieved a very low percentage of non-positive Jacobian determinants (<0.009%), indicating excellent preservation of anatomical structure and topological continuity.
  • Efficiency: LADDA achieved competitive registration accuracy with relatively lower computational time and GPU memory usage compared to other high-performing methods like OTMorph and VMambaMorph.

Limitations and Future Work

  • Limitations:
    • The paper acknowledges that MI loss, while effective, still has limitations for multi-modal registration.
  • Organ motion across different modalities can be discontinuous, leading to challenges with smoothness assumptions and potential blurring of boundaries.
  • Future Work:
    • Developing new loss functions better suited for multi-modal registration.
  • Incorporating anisotropic regularization strategies to handle complex motion and sliding boundaries.
  • Exploring more efficient feature extractors like Mamba.
  • Investigating the integration of segmentation and registration.
  • Leveraging cross-modal pretraining and exploring techniques like segment anything models (SAM) for improved disentanglement capabilities.

Summary updated

Abstract

Deformable image registration (DIR) is critical for accurate clinical diagnosis and effective treatment planning. However, patient movement, significant intensity differences, and large breathing deformations hinder accurate anatomical alignment in multi-modal image registration. These factors exacerbate the entanglement of anatomical and modality-specific style information, thereby severely limiting the performance of multi-modal registration. To address this, we propose a novel LAtent Diffusion-based Domain-Adaptive feature disentangling (LADDA) framework for unsupervised multi-modal medical image registration, which explicitly addresses the representation disentanglement. First, LADDA extracts reliable anatomical priors from the Latent Diffusion Model (LDM), facilitating downstream content-style disentangled learning. A Domain-Adaptive Feature Disentangling (DAFD) module is proposed to promote anatomical structure alignment further. This module disentangles image features into content and style information, boosting the network to focus on cross-modal content information. Next, a Neighborhood-Preserving Hashing (NPH) is constructed to further perceive and integrate hierarchical content information through local neighbourhood encoding, thereby maintaining cross-modal structural consistency. Furthermore, a Unilateral-Query-Frozen Attention (UQFA) module is proposed to enhance the coupling between upstream prior and downstream content information. The feature interaction within intra-domain consistent structures improves the fine recovery of detailed textures. The proposed framework is extensively evaluated on large-scale multi-center datasets, demonstrating superior performance across diverse clinical scenarios and strong generalization on out-of-distribution (OOD) data.
BibTeX
@article{yuan2025ladda,
  author = {Peng Yuan and Jianmin Dong and Wei Zhao and Fei Lyu and Cheng Xue and Yudong Zhang and Chunfeng Yang and Zhan Wu and Zhiqiang Gao and Tianling Lyu and Jean-Louis Coatrieux and Yang Chen},
  title = {{LADDA: Latent Diffusion-based Domain-adaptive Feature Disentangling for Unsupervised Multi-modal Medical Image Registration}},
  journal = {IEEE Journal of Biomedical and Health Informatics},
  year = {2025},
  doi = {10.1109/jbhi.2025.3588511},
}
Figure