Metal Artifact Reduction in 2D CT Images with Self-supervised Cross-domain Learning

Lequan Yu, Zhicheng Zhang, Xiaomeng Li, Hongyi Ren, Wei Zhao, Lei Xing

Abstract

Metal artifacts in Computed Tomography (CT) scans, caused by high-density implants, significantly degrade image quality and clinical utility. Traditional supervised deep learning approaches for Metal Artifact Reduction (MAR) are limited by the lack of paired clinical data—scans of the same patient with and without metal. This paper presents a self-supervised, cross-domain learning framework that trains exclusively on metal-free data. By integrating sinogram completion with a novel differentiable reconstruction loss, the proposed method outperforms existing supervised models and preserves fine anatomical details more effectively than standard approaches.

Introduction

When a patient has a metal implant, such as a hip prosthesis or dental filling, it absorbs X-rays much more strongly than surrounding bone or tissue. In the raw data collected by the CT scanner—the sinogram—these metal objects create "shadows" or missing regions. Upon reconstruction into a 3D image, these gaps manifest as bright streaks and dark bands known as metal artifacts. These artifacts can obscure critical anatomical features, hide tumors, and impede accurate radiation dose calculations for cancer treatment.

While deep learning has shown promise in MAR, most models rely on supervised learning with paired datasets. Since obtaining identical clinical scans with and without metal is physically impossible, researchers typically rely on synthetic data. However, models trained on "fake" artifacts often struggle to generalize to real-world clinical scans. This work addresses these challenges by introducing a self-supervised approach that learns from metal-free data.

Methods

The proposed framework bypasses the need for paired data by treating MAR as a self-supervised inpainting problem. Instead of learning from "bad-to-good" pairs, the model learns by intentionally "breaking" clean data and attempting to restore it.

Overview of the training and testing procedures for the joint network.

The architecture consists of several key components:

  1. SinoNet (Sinogram Completion): The network takes a clean, metal-free sinogram and hides a portion of it to simulate a "metal trace." It is then trained to fill in these missing pixels.
  2. Cross-domain Learning & FBP Loss: To ensure the sinogram repairs are physically consistent, the authors introduce a differentiable Filtered Back Projection (FBP) layer. This allows the network to evaluate how its sinogram repairs look as a reconstructed image during training. The FBP reconstruction loss penalizes repairs that result in image-domain streaks.
  3. ImgNet (Refinement): A secondary module operates in the image domain to further smooth lingering secondary artifacts.
  4. Metal Trace Replacement: To maintain clinical fidelity, the final image is not purely a CNN output. Instead, the original corrupted sinogram is used, with only the pixels within the metal trace replaced by the network's predictions. This ensures the uncorrupted parts of the scan remain 100% authentic.

Results

The model was evaluated using the DeepLesion dataset (1,000 CT slices with 90 simulated metal masks), the MICCAI 2015 Head and Neck dataset for generalization, and real-world clinical data from patients with bilateral hip prostheses.

Comparison of MAR results across different methods on a simulated CT slice. The proposed method (E) achieves the best quantitative metrics and visual clarity.

Quantitative analysis on the DeepLesion dataset demonstrated the superiority of the proposed method. It achieved a Root Mean Square Error (RMSE) of 34.20 HU, significantly outperforming standard Linear Interpolation (50.31 HU) and even supervised state-of-the-art models like DuDoNet (38.00 HU). Qualitatively, the method effectively removed challenging artifacts, such as the "dark bridge" between bilateral hip implants, which often persists in other algorithms. Furthermore, the model generalized well to head CTs despite being trained on torso scans, indicating it learned general principles of X-ray physics rather than specific anatomy.

Conclusion

This self-supervised framework offers a robust solution for MAR by leveraging the underlying geometry of healthy sinograms and incorporating differentiable physics directly into the learning process. By prioritizing clinical fidelity through metal trace replacement, it avoids the "hallucinations" common in other AI models. Future work will focus on extending the framework to 3D volumes to account for cross-slice dependencies and improving the accessibility of raw sinogram data in clinical settings.

Summary updated

Abstract

The presence of metallic implants often introduces severe metal artifacts in the X-ray CT images, which could adversely influence clinical diagnosis or dose calculation in radiation therapy. In this work, we present a novel deep-learning-based approach for metal artifact reduction (MAR). In order to alleviate the need for anatomically identical CT image pairs (i.e., metal artifact-corrupted CT image and metal artifact-free CT image) for network learning, we propose a self-supervised cross-domain learning framework. Specifically, we train a neural network to restore the metal trace region values in the given metal-free sinogram, where the metal trace is identified by the forward projection of metal masks. We then design a novel FBP reconstruction loss to encourage the network to generate more perfect completion results and a residual-learning-based image refinement module to reduce the secondary artifacts in the reconstructed CT images. To preserve the fine structure details and fidelity of the final MAR image, instead of directly adopting CNN-refined images as output, we incorporate the metal trace replacement into our framework and replace the metal-affected projections of the original sinogram with the prior sinogram generated by the forward projection of the CNN output. We then use the filtered backward projection (FBP) algorithms for final MAR image reconstruction. We conduct an extensive evaluation on simulated and real artifact data to show the effectiveness of our design. Our method produces superior MAR results and outperforms other compelling methods. We also demonstrate the potential of our framework for other organ sites.
BibTeX
@misc{yu2021metal,
  author = {Lequan Yu and Zhicheng Zhang and Xiaomeng Li and Hongyi Ren and Wei Zhao and Lei Xing},
  title = {{Metal Artifact Reduction in 2D CT Images with Self-supervised Cross-domain Learning}},
  year = {2021},
  eprint = {2109.13483},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2109.13483},
}
Figure