MRI-to-CT Translation of Spinal Images via Anatomy-Guided Pseudo-Pairing and Adversarial Diffusion

Eduardo Nieto, Ibai Genua, Davide Scorza, Karen López-LinaresarXiv 2026 · arXiv

TL;DR

This paper presents a three-stage framework to synthesize CT scans from spinal MRIs without requiring perfectly paired datasets. By using an anatomy-guided "pseudo-pairing" system to align unpaired slices and a 3D post-processing network to fix inter-slice discontinuities, the authors significantly improve the anatomical fidelity and volumetric coherence of synthetic CTs.

What Problem Does This Paper Address?

In spinal surgery, MRI is the gold standard for visualizing soft tissues (like nerves and discs), but Computed Tomography (CT) is essential for bone visualization and surgical planning. Obtaining both scans increases costs and exposes patients to ionizing radiation.

While deep learning can "translate" MRI to CT, most models require paired data—scans of the same patient in the same position—which are rare and difficult to align perfectly due to motion or different acquisition protocols. Unpaired methods exist, but they often struggle with 3D consistency (the "staircase" effect when 2D slices are stacked) and anatomical accuracy. This paper aims to bridge that gap using unpaired, multi-source data.

Methods

The authors propose a three-stage pipeline:

  1. Vertebral Matching (Pseudo-Pairing): To provide better supervision than random unpaired slices, the system uses spine segmentations to find the most anatomically similar CT slice for every MRI slice. It uses a shape descriptor based on vertebral proportions and aligns the slices via 2D rigid registration.
  2. Adversarial Diffusion (SynDiff): The pseudo-paired slices train a 2D SynDiff model. This architecture uses a non-diffusive module to create a rough approximation of the CT, followed by a diffusive module that iteratively refines the image to match the CT style while maintaining anatomical consistency.
  3. 3D Contextual Consistency Enhancement: Because the translation happens slice-by-slice in 2D, the resulting 3D volume can have jagged edges. The authors apply a 3D Generative Adversarial Network (GAN) with a ResUNet generator to smooth these discontinuities and ensure the vertebrae look coherent across axial and coronal views.
Figure 1: Data flow diagram illustrating the full pipeline from raw data to the final dataset construction. Starting from 2844 CT scans and 560 MR scans, vertebral segmentations are obtained via TotalSegmentator, followed by manual filtering and region-based subvolume extraction. Subvolumes are then automatically filtered based on the quality of their segmentation masks, discarding those with anomalous or incomplete vertebral segmentations. Since the downstream translation model operates on 2D, sagittal slices are extracted from the subvolumes. Finally, the resulting slices are split into training, validation and test sets.

Datasets

The study utilized 10 distinct open-access datasets to ensure coverage across cervical, thoracic, and lumbar regions.

  • MRI: 558 scans (including Spine Generic Project, SPIDER, and TotalSegmentator).
  • CT: 1,136 scans (including PDDCA, HaN-Seg, and CTSpine1K). The final training set consisted of over 10,000 sagittal slices, with 1,911 slices reserved for testing.

Key Insights and Ideas

  • Anatomy-Guided Supervision: The "aha moment" is that even if you don't have the same patient's CT, training on a similar patient's aligned vertebral structure (pseudo-pairing) is far more effective than purely unsupervised training.
  • Efficiency vs. Accuracy: The authors used the "elbow method" to determine that comparing an MRI slice to the top 50 CT candidates provided the optimal trade-off between matching accuracy and computational cost.
  • The 2D/3D Hybrid Approach: Rather than attempting full 3D diffusion—which is computationally massive—the authors show that 2D diffusion followed by a lightweight 3D GAN refinement can achieve high-quality volumetric results.
The vertebral matching system used to create pseudo-pairs

Key Results

  • Quantitative Improvement: The proposed pipeline increased the binary 3D Dice score (measuring vertebral reconstruction accuracy) from 0.666 (baseline diffusion) to 0.739.
  • Anatomical Fidelity: The vertebral matching stage was the primary driver for better alignment, reducing the relative Maximum Mean Discrepancy (rMMD) from 0.135 to 0.053.
  • Visual Coherence: The 3D post-processing network successfully eliminated "staircase" artifacts, producing smoother vertebral contours in axial and coronal planes, which are critical for surgical navigation.
The 3D post-processing architecture designed to improve volumetric coherence

Limitations and Future Work

  • Sacrum and Posterior Elements: These regions remain the most "failure-prone" due to high anatomical variability and lower representation in public datasets.
  • Smoothing Artifacts: While the 3D refinement improves bone coherence, it can introduce mild smoothing in non-bone tissues, which slightly degrades global image realism metrics like FID.
  • Lack of Paired Ground Truth: Because the study uses unpaired data, the evaluation is limited to distributional metrics and downstream segmentation tasks rather than direct voxel-to-voxel comparison.
  • Future Directions: The authors suggest exploring fully 3D translation networks and integrating more sophisticated anatomical priors to preserve fine-grained intensity details.

Summary updated

Abstract

Magnetic Resonance Imaging (MRI) is routinely used to diagnose spinal disorders, but surgical planning often requires Computed Tomography (CT) for better visualization of vertebral bone anatomy. Synthesizing CT from MRI could avoid additional radiation exposure and streamline preoperative assessment. We propose a three-stage framework for spine MRI-to-CT synthesis. First, an anatomy-guided vertebral matching system identifies similar sagittal MRI and CT slices using spine segmentations and aligns them through rigid registration, creating pseudo-paired data from unpaired scans. Second, these pairs train an adversarial diffusion model for MRI-to-CT translation. Third, synthesized slices are assembled into 3D volumes and refined by a network that improves inter-slice continuity and structural coherence. The framework was trained on over 10,000 unpaired sagittal MRI and CT slices and evaluated on 1,911 slices from 83 MRI volumes spanning all spinal regions. Assessment combined distribution-based measures with vertebral segmentation metrics. Compared with diffusion alone, the proposed approach increased binary 3D vertebral Dice from 0.666 to 0.739. Volumetric post-processing reduced visible discontinuities between stacked slices and improved vertebral coherence in axial and coronal views. Combining anatomy-guided pseudo-pairing, adversarial diffusion and 3D refinement improves spine MRI-to-CT synthesis. Vertebral matching primarily enhanced anatomical alignment and fidelity, while volumetric refinement improved 3D consistency. These findings support further development of MRI-derived CT-like visualization for preoperative planning, particularly to preserve fine intensity details while maintaining volumetric coherence.
BibTeX
@misc{nieto2026mri,
  author = {Eduardo Nieto and Ibai Genua and Davide Scorza and Karen López-Linares},
  title = {{MRI-to-CT Translation of Spinal Images via Anatomy-Guided Pseudo-Pairing and Adversarial Diffusion}},
  year = {2026},
  eprint = {2610.37134},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.37134},
}
Figure