Introduction: The Traceability Gap in Medical Imaging
In medical diagnostics, translating images between modalities (e.g., MRI to CT) or predicting disease progression is vital. While Generative Adversarial Networks (GANs) and Diffusion Models produce high-fidelity synthetic images, they often operate as "black boxes." For clinicians, these models suffer from a critical flaw: a lack of traceability.
Most existing models change pixel intensities without accounting for anatomical movement. If a lesion appears in a translated image, a doctor must be able to verify its exact correspondence in the original scan. Without this spatial correspondence, synthetic images remain clinically untrustworthy.
The Plasticine Framework
To address this, the authors introduce Plasticine, a diffusion-based framework designed to decouple intensity shifts from spatial warping. Plasticine integrates two primary components within a single denoising routine:
- Diffusion Intensity Translation: Unlike standard models starting from Gaussian noise, Plasticine begins denoising from a noised version of the source image, guided by unsupervised "structure maps" to maintain basic content shapes.
- Cross-Modality Spatial Transformation: A dedicated module predicts diffeomorphic deformations ($\phi$). These are smooth, invertible, and topology-preserving mappings that ensure anatomical "stretching" remains biologically plausible.
By learning the deformation field $\phi$ alongside intensity changes, Plasticine enables "interactive tracking." A clinician can select a region of interest in the source image and trace its exact transformation into the target modality, as shown in the heart translation example above.
Experimental Evaluation and Results
Plasticine was evaluated on three distinct tasks: Retinal OCT protocol translation, Chest MRI-to-CT, and Cardiac MRI pathology prediction (using datasets like UKBiobank and Learn2Reg).
Performance Metrics
The model consistently outperformed state-of-the-art baselines like CycleGAN, MUNIT, and DDIB:
- Structural Accuracy: On Retinal OCT data, Plasticine achieved a Dice score of 0.801, far exceeding CycleGAN (0.624), indicating superior anatomical alignment.
- Synthesis Quality: Plasticine recorded a Fréchet Inception Distance (FID) of 96.28, significantly better than MUNIT’s 119.77.
Clinical Validation
A study involving three clinicians confirmed that Plasticine’s generated lesions were more anatomically "reasonable" and provided significantly higher satisfaction regarding traceability compared to non-traceable baselines.
Conclusion and Future Work
Plasticine represents a significant step toward interpretable AI in medicine. By providing a mathematical bridge (the deformation field) between source and target images, it moves beyond simple image generation toward true anatomical translation. While currently limited to 2D images and requiring structure map pre-processing, future work aims to extend the framework to 3D volumes to better support full clinical workflows.
Summary updated