i-RIM applied to the fastMRI challenge

Patrick Putzky, Dimitrios Karkalousos, Jonas Teuwen, Nikita Miriakov, Bart Bakker, Matthan W. A. Caan, Max WellingarXiv 2019 · arXiv

Abstract

Team AImsterdam presents a solution for the fastMRI challenge based on the invertible Recurrent Inference Machine (i-RIM). By employing an invertible architecture, the researchers successfully trained a massive 480-layer deep network that iteratively reconstructs high-quality MRI images from undersampled data. This method bypasses the memory bottlenecks typically associated with extreme network depth and avoids the need for explicit coil sensitivity modeling, resulting in a robust, data-driven reconstruction pipeline.

Introduction

Magnetic Resonance Imaging (MRI) is a critical diagnostic tool, yet its slow acquisition speed remains a significant drawback, impacting patient comfort and clinical throughput. "Accelerated MRI" aims to reduce scan times by undersampling measurements in k-space (the raw data domain). However, this creates an ill-posed inverse problem: reconstructing a clear, diagnostic-quality image from incomplete and noisy data.

Traditional reconstruction methods often rely on complex mathematical models of hardware-specific parameters, such as coil sensitivity maps. In this work, the authors propose a more direct, data-driven approach using the i-RIM to solve the reconstruction problem while scaling to unprecedented network depths.

Methods: The Invertible Recurrent Inference Machine

The core of the proposed solution is the i-RIM, an invertible variant of the Recurrent Inference Machine.

Iterative Inference

Rather than a single-pass reconstruction, the i-RIM iteratively updates its image estimate. At each step, the model considers the current data consistency gradient (the error relative to the acquired k-space data), the current image estimate, and a hidden latent state to refine the output.

Invertibility for Extreme Depth

The defining feature of the i-RIM is its fully invertible architecture. In standard deep learning, training deep networks requires storing activations for every layer to compute gradients, which quickly exhausts GPU memory. Invertible layers allow these activations to be recalculated on the fly during the backward pass. This memory efficiency enabled the team to stack 12 down-sampling blocks across 8 iterative steps, creating a 480-layer deep network.

Implicit Multi-Coil Handling and Metadata

Unlike traditional methods, the i-RIM does not explicitly calculate spatial coil sensitivity maps. Instead, it stacks data from all coils into a single vector, allowing the network to learn inter-coil relationships directly. Furthermore, the model is seeded with metadata (e.g., magnetic field strength, fat suppression status) via a 1-hot vector, enabling the network to adapt its reconstruction pathway to the specific physics of the scan.

Datasets and Evaluation

The model was evaluated using the fastMRI dataset, a large-scale benchmark provided by NYU Langone Health and Facebook AI Research. The team participated in both the single-coil and multi-coil tracks, testing 4x and 8x acceleration factors (corresponding to 25% and 12.5% data retention, respectively).

Results

The i-RIM demonstrated strong performance across all test categories. Quantitatively, the model achieved high Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) scores, as shown in Table 1.

Table 1: Performance of i-RIM on the fastMRI Test Set | Track | Acceleration | NMSE (↓) | PSNR (↑) | SSIM (↑) | | :--- | :--- | :--- | :--- | :--- | | Multi-coil | 4x | 0.0052 | 39.52 | 0.928 | | Multi-coil | 8x | 0.0093 | 36.53 | 0.887 | | Single-coil | 4x | 0.0272 | 33.65 | 0.781 | | Single-coil | 8x | 0.0421 | 30.56 | 0.687 |

Qualitatively, the reconstructions were highly effective. The authors noted that the model effectively denoised the scans during reconstruction, sometimes appearing to improve upon the visual quality of the ground truth.

Figure 1: A reconstructed MRI knee scan demonstrating the model's ability to recover structure from undersampled data.
Figure 2: A high-fidelity reconstruction showing clear anatomical detail, achieved through the 480-layer deep i-RIM architecture.

Discussion and Conclusion

The success of the i-RIM highlights several key insights in deep learning for medical imaging. First, depth is a significant driver of performance; invertibility serves as a "cheat code" to reach depths that were previously computationally prohibitive. Second, by treating multi-coil data as a stacking problem, the researchers simplified the preprocessing pipeline while relying on the network's capacity to learn underlying geometric priors.

While the i-RIM is memory-efficient, it remains computationally intensive due to the number of iterations required. Additionally, as with all deep-learning-based reconstruction, there is a theoretical risk of "hallucination"—where the model's strong statistical prior might introduce features not present in the original anatomy or smooth over subtle pathologies. Future work will likely focus on optimizing training time and further validating the clinical reliability of these deep reconstructions.

Summary updated

Abstract

We, team AImsterdam, summarize our submission to the fastMRI challenge (Zbontar et al., 2018). Our approach builds on recent advances in invertible learning to infer models as presented in Putzky and Welling (2019). Both, our single-coil and our multi-coil model share the same basic architecture.
BibTeX
@misc{putzky2019i,
  author = {Patrick Putzky and Dimitrios Karkalousos and Jonas Teuwen and Nikita Miriakov and Bart Bakker and Matthan W. A. Caan and Max Welling},
  title = {{i-RIM applied to the fastMRI challenge}},
  year = {2019},
  eprint = {1910.08952},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1910.08952},
}
Figure