Automating Motion Correction in Multishot MRI Using Generative Adversarial Networks

Siddique Latif, Muhammad Asim, Muhammad Usman, Junaid Qadir, Rajib RanaarXiv 2018 · arXiv

TL;DR

Multishot MRI accelerates data acquisition but is highly sensitive to patient movement, which introduces severe motion artifacts into the final images. This paper introduces an end-to-end Generative Adversarial Network (GAN) framework that bypasses slow, traditional motion-estimation algorithms, correcting artifacts up to two orders of magnitude faster while delivering superior image fidelity.

What Problem Does This Paper Address?

While classical MRI can be slow, multishot Magnetic Resonance Imaging (MRI) speeds up the acquisition process by filling the "k-space" (the raw spatial frequency data) fractionally across multiple separate "shots." However, this makes the technique incredibly sensitive to patient movement. Even minor displacements from respiration or slight head shifts dislocate the k-space data between shots, creating disruptive motion artifacts that can lead to medical misdiagnosis.

Existing state-of-the-art motion correction methods rely on iterative algorithms to estimate and correct these motion states. Unfortunately, these methods are computationally expensive and painfully slow, making them impractical for real-time clinical workflows. The authors aim to eliminate this computational bottleneck using deep learning.

Methods

The authors propose a hybrid framework that pairs a standard parallel MRI reconstruction algorithm with a deep generative model:

  1. Initial Reconstruction: The motion-corrupted k-space data is first reconstructed into the image domain using the standard Conjugate Gradient Sensitivity Encoding (CG SENSE) algorithm.
  2. GAN-based Correction: The resulting artifact-heavy image is then passed through a Generative Adversarial Network (GAN) tasked entirely with removing the motion artifacts.
Figure 1: The proposed motion correction framework for multishot MRI, where CG SENSE is used to reconstruct the motion-corrupted images, and the generator network of the GAN, in conjunction with the discriminator network, is tasked with motion correction.

Network Architecture

  • Generator ($G$): A U-Net-like convolutional architecture consisting of encoding and decoding blocks. Each encoder block contains 5 convolutional layers. The decoder blocks mirror this structure but replace standard convolutions with transposed convolutions to upsample the image back to its original resolution.
  • Discriminator ($D$): Matches the exact architecture of the U-Net's encoder stage.
Figure 2: Architecture of the generator network (U-Net) consisting of encoding and decoding blocks. The discrim- inator has exactly the same architecture as the encoder part of our U-Net.

The network is trained using a standard minimax adversarial loss function, optimized via the RMSProp optimizer. The generator is also pre-trained to ensure faster, more stable convergence.

Datasets

Because no public datasets of motion-corrupted MR images exist, the authors synthetically simulated data using the BRATS 2015 dataset (a collection of motion-free brain tumor images).

To create realistic multishot artifacts, they transformed the image-domain data back into simulated k-space data, introduced varying degrees of sudden rotational motion (5°, 8°, 10°, 12°, and 14°) for individual shots, and then recombined the segments. The final dataset was split into:

  • Training set: 13,019 images (70%)
  • Testing set: 5,580 images (30%)

Key Insights and Ideas

  • Implicit vs. Explicit Correction: Traditional methods try to explicitly calculate the exact mathematical parameters of the patient's physical movement. The GAN bypasses this entirely by implicitly learning the statistical mapping from "corrupted image space" to "clean image space."
  • Graceful Degradation: While traditional iterative methods completely break down or fail to converge when head rotation exceeds 10°, the GAN's deep priors allow it to recover highly acceptable, clinically useful images even at extreme 14° rotations.

Key Results

The quantitative and qualitative improvements over the baseline iterative method (Cordero et al.) are stark:

  • Massive Speedups: For a mild 5° motion artifact, the GAN approach corrects the image in just 0.22 seconds, compared to 25.23 seconds for the baseline—a 114x speedup. At a severe 14° rotation, the GAN takes 0.34 seconds while the baseline balloons to 152.03 seconds.
  • Image Quality: The framework achieves a Peak Signal to Noise Ratio (PSNR) of 31.82 and a Structural Similarity Index (SSIM) of 0.95 for 5° rotations, maintaining a highly acceptable PSNR of 26.82 even at 14°.
Figure 3: Qualitative results of our solution’s output (third row) for increasing degrees of motion 5°, 8°, 10°, 12°, and 14° compared with on motion-corrupted MRI images (first row), groundtruth images (bottom row), and state-of-the-art algorithm [3]’s output (second row). It can be seen that the output of our algorithm is qualitatively better than the output of previous approach.

As seen in the qualitative results, the GAN approach yields significantly sharper brain structures and fewer residual ghosting artifacts than previous approaches.

Limitations and Future Work

Despite the impressive speed and structural recovery, the authors note that at severe levels of motion degradation (e.g., 14°), the network tends to generate overly smooth images, losing some fine-grained textures due to the intensity of the corruption.

Additionally, this initial study was limited strictly to 2-shot MRI acquisitions. The authors plan to scale their GAN approach to handle a higher number of shots and conduct more extensive clinical validation in future work.

Summary updated

Abstract

Multishot Magnetic Resonance Imaging (MRI) has recently gained popularity as it accelerates the MRI data acquisition process without compromising the quality of final MR image. However, it suffers from motion artifacts caused by patient movements which may lead to misdiagnosis. Modern state-of-the-art motion correction techniques are able to counter small degree motion, however, their adoption is hindered by their time complexity. This paper proposes a Generative Adversarial Network (GAN) for reconstructing motion free high-fidelity images while reducing the image reconstruction time by an impressive two orders of magnitude.
BibTeX
@misc{latif2018automating,
  author = {Siddique Latif and Muhammad Asim and Muhammad Usman and Junaid Qadir and Rajib Rana},
  title = {{Automating Motion Correction in Multishot MRI Using Generative Adversarial Networks}},
  year = {2018},
  eprint = {1811.09750},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1811.09750},
}

Loading related content...

Figure