MOdel-Based SyntheTic Data-Driven Learning (MOST-DL): Application in Single-Shot T2 Mapping With Severe Head Motion Using Overlapping-Echo Acquisition

Qinqin Yang, Yanhong Lin, Jiechao Wang, Jianfeng Bao, Xiaoyin Wang, Lingceng Ma, Zihan Zhou, Qizhi Yang, Shuhui Cai, Hongjian He, Congbo Cai, Jiyang Dong, Jingliang Cheng, Zhong Chen, Jianhui Zhong

TL;DR

This paper introduces MOST-DL, a novel framework that uses model-based synthetic data generation to train deep learning models for MRI. This approach effectively bridges the "domain gap" between simulated and real-world data, enabling robust T2 mapping even with severe head motion, a critical challenge for patient populations.

What Problem Does This Paper Address?

Deep learning has shown immense promise in medical imaging, but its reliance on large, well-annotated datasets is a major bottleneck. Acquiring such datasets in MRI is expensive and time-consuming, and often, ground truth data for complex scenarios like motion-corrupted scans is unavailable. This "domain gap" between synthetic and real data hinders the generalization of AI models. The authors specifically target the problem of T2 mapping, a quantitative MRI technique, in the presence of severe head motion, which is common in patients who cannot remain still (e.g., elderly, children, those with neurological conditions). Existing methods struggle with this, leading to ghosting and motion artifacts in the resulting T2 maps.

Methods

The core of the MOST-DL framework is its sophisticated synthetic data generation pipeline. It combines:

  • Bloch Simulation: This physics-based simulation models the signal evolution in MRI, incorporating the specific pulse sequence (SE-MOLED in this case).
  • General MRI Models: This includes modeling the acquisition process, such as parallel imaging (using coil sensitivity maps) and the effects of non-ideal factors.
  • Realistic Anatomical Textures: Instead of simple geometric shapes, the authors leverage a public database of real MRI scans to create realistic parametric templates (for T1, T2, and Mo values). This significantly improves the realism of the synthetic data.
  • Domain Randomization: To further bridge the synthetic-to-real gap, various non-ideal factors are randomized during generation. These include:
  • Sub-voxel Motion: A key innovation is modeling rigid motion at the sub-voxel level within the Bloch simulation, capturing the complex phase accumulation that occurs during motion.
  • B+ Inhomogeneity: Simulating variations in the radiofrequency field.
  • Gradient Imperfections: Modeling random fluctuations in gradient fields.
  • Noise: Adding realistic Gaussian noise.

This synthetic data is then used to train two Convolutional Neural Networks (CNNs): one for calibrationless parallel reconstruction and another for end-to-end T2 mapping with intra-shot motion correction.

Datasets

  • Training Data: The paper generates synthetic datasets using the MOST-DL framework. These datasets are derived from:
  • IXI Dataset: A public database of multi-contrast MRI images used to create realistic anatomical templates.
  • Simulated Data: Generated through the MOST-DL pipeline, incorporating Bloch simulation, MRI models, and randomized non-ideal factors.
  • Evaluation Data:
    • Numerical Human Brain Experiments: Simulated data with known ground truth parameters, including various levels of motion.
  • In Vivo Human Brain Data: Acquired from healthy volunteers and a patient with epilepsy, including both motion-free and motion-corrupted scans.

Key Insights and Ideas

  • Bridging the Domain Gap with Realistic Textures: Using real anatomical textures from public databases, rather than abstract shapes, is crucial for generating synthetic data that generalizes well to real-world MRI.
  • Sub-Voxel Motion Modeling is Critical: Accurately simulating motion at the sub-voxel level within the Bloch simulation is key to achieving robust motion correction, especially for intra-shot motion.
  • Model-Based Synthetic Data as a Powerful Alternative: MOST-DL demonstrates that a well-designed model-based synthetic data generation pipeline can overcome the limitations of scarce real-world data, enabling high-performance deep learning for challenging MRI tasks.
  • End-to-End Motion Correction and Mapping: Combining parallel reconstruction and T2 mapping into a single, data-driven pipeline, powered by synthetic data, simplifies the process and improves robustness.
  • Non-Ideal Factor Reconstruction for Validation: The ability to reconstruct non-ideal factors (like velocity fields) from the trained network serves as a valuable quality control mechanism, validating the accuracy of the synthetic data generation.

Key Results

  • Motion-Robust T2 Mapping: The MOST-DL method significantly reduces ghosting and motion artifacts in T2 maps, achieving high quality even with severe head motion.
  • Improved Quantitative Accuracy: In numerical experiments, motion correction improved the R² value of linear regression analysis from 0.198 to 0.824 (slight motion) and 0.030 to 0.822 (severe motion). In vivo experiments showed a mean T2 difference of 0.98 ms with MOST-DL correction, compared to 2.54 ms without correction.
  • High-Quality Parallel Reconstruction: The proposed method achieved low ghost-to-signal ratio (GSR) values in both motion-free and motion-corrupted cases, outperforming several existing calibration-based and calibrationless methods.
  • Generalizability: The network trained on purely synthetic data generalized well to in vivo human brain data without further fine-tuning.

Limitations and Future Work

  • Limited Anatomical Coverage of Public Datasets: While the IXI dataset is useful, it may not always provide sufficient anatomical coverage for all regions (e.g., abdomen, prostate, knee). The authors suggest using GAN-based methods for missing contrast synthesis.
  • In-Plane Motion Focus: The current framework primarily simulates and corrects for in-plane rigid motion. Severe through-plane motion still degrades results, and future work will focus on extending the framework to 3D and non-rigid motion.
  • Computational Cost of Bloch Simulation: While GPU acceleration is used, Bloch simulation remains computationally intensive. More efficient data generation techniques are needed.
  • Extension to Other Sequences and Fields: The MOST-DL framework is generalizable to other MRI sequences and potentially other model-based medical imaging fields, provided the underlying physical models and non-ideal factors can be accurately modeled. Future work will explore inter-shot motion correction for multi-shot sequences.

Summary updated

Abstract

Use of synthetic data has provided a potential solution for addressing unavailable or insufficient training samples in deep learning-based magnetic resonance imaging (MRI). However, the challenge brought by domain gap between synthetic and real data is usually encountered, especially under complex experimental conditions. In this study, by combining Bloch simulation and general MRI models, we propose a framework for addressing the lack of training data in supervised learning scenarios, termed MOST-DL. A challenging application is demonstrated to verify the proposed framework and achieve motion-robust [Formula: see text] mapping using single-shot overlapping-echo acquisition. We decompose the process into two main steps: (1) calibrationless parallel reconstruction for ultra-fast pulse sequence and (2) intra-shot motion correction for [Formula: see text] mapping. To bridge the domain gap, realistic textures from a public database and various imperfection simulations were explored. The neural network was first trained with pure synthetic data and then evaluated with in vivo human brain. Both simulation and in vivo experiments show that the MOST-DL method significantly reduces ghosting and motion artifacts in [Formula: see text] maps in the presence of unpredictable subject movement and has the potential to be applied to motion-prone patients in the clinic. Our code is available at https://github.com/qinqinyang/MOST-DL.
BibTeX
@article{yang2022model,
  author = {Qinqin Yang and Yanhong Lin and Jiechao Wang and Jianfeng Bao and Xiaoyin Wang and Lingceng Ma and Zihan Zhou and Qizhi Yang and Shuhui Cai and Hongjian He and Congbo Cai and Jiyang Dong and Jingliang Cheng and Zhong Chen and Jianhui Zhong},
  title = {{MOdel-Based SyntheTic Data-Driven Learning (MOST-DL): Application in Single-Shot T<sub>2</sub> Mapping With Severe Head Motion Using Overlapping-Echo Acquisition}},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2022},
  doi = {10.1109/tmi.2022.3179981},
}
Figure