Erase to Enhance: Data-Efficient Machine Unlearning in MRI Reconstruction

Yuyang Xue, Jingshuai Liu, Steven McDonagh, Sotirios A. Tsaftaris

Introduction

In the rapidly evolving field of medical AI, the prevailing wisdom has long been that more data leads to better generalization. To this end, researchers frequently aggregate datasets from diverse sources—combining brain, knee, and abdominal MRI scans—to train robust reconstruction models. However, this "data agglomeration" introduces a significant clinical risk: hallucinations. When a model trained on heterogeneous data attempts to reconstruct a specific organ, it may inadvertently incorporate features from unrelated anatomies, leading to artifacts that can compromise diagnostic accuracy.

Beyond clinical utility, emerging privacy regulations like the General Data Protection Regulation (GDPR) increasingly demand the "right to be forgotten," requiring that specific patient data be removable from trained models. This paper introduces the first framework for machine unlearning in MRI reconstruction, providing a method to "scrub" problematic or private data without the prohibitive cost of retraining from scratch.

The Challenge of Unlearning in Reconstruction

Machine unlearning has been extensively studied in classification tasks, where the goal is to remove a sample's influence on a discrete label. However, MRI reconstruction is a generative image-to-image task. The model must learn the complex mapping from undersampled $k$-space data to high-fidelity anatomical images.

The authors address two primary motivations for unlearning in this domain:

  1. Mitigating Hallucinations: Removing the influence of "out-of-distribution" data (e.g., knee scans) that causes the model to hallucinate non-existent structures in target scans (e.g., brain scans).
  2. Regulatory Compliance: Efficiently removing specific data points to satisfy privacy requirements.

Methodology: The Erase-to-Enhance Framework

The study utilizes the E2E-VarNet architecture and establishes a controlled experimental setup using the FastMRI dataset. They define a "retain set" (T2-weighted brain slices) and a "forget set" (knee slices) at a 10:1 ratio. The objective is to transition a model trained on both datasets into an "unlearned" state that mimics an "Oracle" model—one trained exclusively on the retain set.

To achieve this, the authors evaluated three core strategies adapted for reconstruction:

  • Fine-tuning (FT): Continuing the training process using only the retain data. While safe, this is often too slow to effectively "erase" the forget set's influence.
  • Gradient Ascent (GA): Instead of minimizing error, the model maximizes the loss on the forget set, effectively scrambling its knowledge of those samples. To prevent weight explosion, the authors implemented $\ell_1$-regularization.
  • Noisy Labeling (NL): The model is trained to map inputs from the forget set to random Gaussian noise rather than the correct anatomical target, breaking the learned reconstruction logic for those specific samples.

The Hybrid Approach

The researchers discovered that pure unlearning (GA or NL) often leads to "catastrophic forgetting" or model collapse, where the model loses its general ability to reconstruct any image. The solution lies in a hybrid protocol: NL-FT or GA-$\ell_1$-FT. By interleaving unlearning steps with fine-tuning on the retain data, the retain set acts as a "stabilizing anchor," ensuring the model maintains high diagnostic quality while purging the unwanted data.

Key Insights and Results

1. Superiority of Noisy Labeling (NL-FT)

The NL-FT approach emerged as the most effective strategy. It achieved a Brain Test Accuracy (BTA) of 38.24 dB PSNR, remarkably close to the Oracle model's 39.36 dB. Simultaneously, it successfully degraded performance on the forget set to match a model that had never seen a knee scan, effectively "scrubbing" the unwanted influence.

2. Data and Computational Efficiency

One of the most significant findings is the framework's efficiency. Traditional methods for removing data require retraining the model from scratch, which is computationally expensive for high-resolution MRI models. This unlearning protocol achieves comparable results in just 10% of the original training time. Furthermore, the authors found that using only a subset of the retain data during the unlearning process is often sufficient, and in some cases, more stable than using the full dataset.

3. Hallucination Suppression

Qualitative analysis confirmed that the unlearning process directly impacts clinical reliability. Models treated with the NL-FT protocol successfully removed hallucinations—such as knee-like artifacts appearing in brain reconstructions—that were present in the original mixed-data model. This results in a cleaner, more faithful reconstruction of the target anatomy.

Limitations and Future Directions

While this work marks a milestone in medical AI safety, the authors note several challenges for future research:

  • Anatomical Similarity: Unlearning distinct anatomies (brain vs. knee) is a clear-cut case. Future work must address the difficulty of unlearning specific samples within highly similar datasets (e.g., removing one patient's brain scan from a pool of thousands).
  • The Pareto Optimum: The study observed a "more is less" paradox where using too much retain data during fine-tuning sometimes hindered the unlearning process. Finding the optimal balance for subset selection remains an open question.
  • Subtle Artifacts: Beyond organ-level differences, the framework should be tested against more subtle data biases, such as those originating from specific scanner hardware or demographic imbalances.

Conclusion

"Erase to Enhance" demonstrates that machine unlearning is not only possible but highly efficient in the context of MRI reconstruction. By strategically combining noisy labeling with targeted fine-tuning, researchers can build medical AI systems that are more adaptable, privacy-compliant, and less prone to dangerous hallucinations.

Summary updated

Abstract

Machine unlearning is a promising paradigm for removing unwanted data samples from a trained model, towards ensuring compliance with privacy regulations and limiting harmful biases. Although unlearning has been shown in, e.g., classification and recommendation systems, its potential in medical image-to-image translation, specifically in image reconstruction, has not been thoroughly investigated. This paper shows that machine unlearning is possible in MRI tasks and has the potential to benefit for bias removal. We set up a protocol to study how much shared knowledge exists between datasets of different organs, allowing us to effectively quantify the effect of unlearning. Our study reveals that combining training data can lead to hallucinations and reduced image quality in the reconstructed data. We use unlearning to remove hallucinations as a proxy exemplar of undesired data removal. Indeed, we show that machine unlearning is possible without full retraining. Furthermore, our observations indicate that maintaining high performance is feasible even when using only a subset of retain data. We have made our code publicly accessible.
BibTeX
@inproceedings{xue2024erase,
  author = {Yuyang Xue and Jingshuai Liu and Steven McDonagh and Sotirios A. Tsaftaris},
  title = {{Erase to Enhance: Data-Efficient Machine Unlearning in MRI Reconstruction}},
  booktitle = {MIDL},
  year = {2024},
  url = {https://openreview.net/forum?id=IZVhnz6EZ5},
}
Figure