Introduction
High-quality medical image segmentation tools are typically optimized for specific modalities, such as T1-weighted (T1w) MRI. Adapting these tools to a different modality, like Proton Density-weighted (PDw) images, often necessitates training new models from scratch, a process constrained by the limited availability of labeled data. While Generative Adversarial Networks (GANs) and recent diffusion models like SDEdit attempt to bridge this gap, they frequently require exposure to both domains during training or struggle to maintain anatomical integrity in zero-shot scenarios.
To address these challenges, this paper introduces LMIDiffusion, a novel unsupervised framework that utilizes diffusion models to translate medical images between modalities without prior exposure to the source modality during training. By employing Locale-based Mutual Information (LMI) as a guidance mechanism, the model preserves anatomical structures while adapting to new modalities, enabling the use of existing segmentation tools on previously "unseen" data types.
Methods
LMIDiffusion treats cross-modality translation as a guided denoising process. The framework uses a score-matching diffusion backbone trained exclusively on the target modality (e.g., T1w images).
The core innovation is the use of Locale-based Mutual Information (LMI). Unlike pixel-to-pixel mappings, LMI leverages the fact that local statistical relationships—such as edges and boundaries—remain consistent across different modalities. During the sampling phase, the LMI between the source image and the current noisy state guides the diffusion process. This ensures the generated image adopts the style of the target modality while strictly adhering to the anatomical structure of the source. This general statistical approach grants the model zero-shot capability, as it does not require retraining when the source modality changes.
Results and Insights
The researchers evaluated LMIDiffusion using the IXI dataset, translating PDw images to T1w for subsequent segmentation using a K-Means algorithm trained only on T1w data.
LMIDiffusion significantly outperformed both GAN-based and other diffusion-based baselines across key quantitative metrics:
| Metric | CycleGAN | StyleGAN | SDEdit | LMIDiffusion |
|---|---|---|---|---|
| Dice Score | 0.85 ± 0.07 | 0.66 ± 0.10 | 0.82 ± 0.06 | 0.88 ± 0.05 |
| PSNR | 18.88 ± 1.26 | 10.15 ± 1.49 | 15.96 ± 1.54 | 20.22 ± 1.43 |
| SSIM | 0.27 ± 0.04 | 0.06 ± 0.03 | 0.50 ± 0.06 | 0.69 ± 0.06 |
The Dice score of 0.88 indicates that the translated images were accurate enough for a segmentation tool that had never seen a PDw image. Qualitatively, LMIDiffusion retained sharp anatomical details that were often blurred or distorted by CycleGAN or StyleGAN.
Key insights from the study include:
- Statistical Homogeneity: LMI captures the semantic essence of boundaries without needing paired training data.
- Anatomy Preservation: LMI guidance acts as a rigid structural constraint, preventing the hallucinations common in standard diffusion-based editing.
- Clinical Practicality: The model's adaptability to different scanners and protocols without retraining makes it highly suitable for real-world clinical settings.
Conclusion and Future Work
While LMIDiffusion offers superior structural preservation and zero-shot flexibility, its iterative sampling process is computationally slower than the single-pass inference of GANs. Future research will focus on refining the guidance mechanism, potentially incorporating few-shot learning, and exploring the model's performance on complex pathological images, such as tumors, where appearance changes drastically across modalities.
Summary updated