Encoding Metal Mask Projection for Metal Artifact Reduction in Computed Tomography

Yuanyuan Lyu, Wei-An Lin, Haofu Liao, Jingjing Lu, S. Kevin ZhouMICCAI 2020 · OpenReview

TL;DR

This paper introduces a novel deep learning approach for reducing metal artifacts in CT scans by encoding the geometry of metal implants directly into the sinogram restoration process. Their method significantly improves anatomical precision and image quality compared to existing techniques, especially for large metallic objects.

What Problem Does This Paper Address?

Computed Tomography (CT) is a vital diagnostic tool, but metallic implants (like prosthetics or dental fillings) cause severe artifacts in the resulting images. These artifacts, known as metal artifacts, are complex and non-local in the image domain, making them difficult to remove. While some methods try to fix these artifacts in the image itself or by treating affected sinogram regions as "missing" data, these approaches often lead to over-smoothed images or fail to capture fine details, especially around dense metal objects. The challenge is to effectively remove these artifacts while preserving crucial anatomical information.

Methods

The authors propose a novel network architecture that builds upon existing dual-domain (sinogram and image) learning approaches. Their key innovation lies in how they handle the metal information:

  • Encoding Metal Mask Projection (Mp): Instead of using a simple binarized "metal trace" (which just indicates presence/absence), they utilize a "metal mask projection" (Mp). This projection encodes the geometric information of the metal implants, providing a richer representation.
  • Retaining Metal-Affected Regions: Crucially, their approach doesn't discard the metal-affected regions in the sinogram. Instead, it learns to correct them while preserving the underlying geometric information from the metal mask projection.
  • Dual-Domain Network (SEp-IE-Net): The network consists of two main parts:
  • Sinogram Enhancement Network (SE-Net): This network takes the corrupted sinogram and the metal mask projection (Mp) as input to restore a cleaner sinogram. They also introduce a "sinogram padding" strategy to better handle the periodic nature of sinogram data.
  • Image Enhancement Network (IE-Net): This network takes the enhanced sinogram (reconstructed into an image) and the metal mask projection (Mp) to further refine the image and remove secondary artifacts.
  • Loss Function: A combined loss function is used, incorporating sinogram enhancement loss, image enhancement loss, and a "Radon consistency loss" to ensure alignment between the sinogram and image domains.

Datasets

  • Simulation Data: A large dataset of 360,000 cases for training and 2,000 cases for testing was generated. This simulation involved resizing clean CT images, using specific imaging geometry (640 projection angles, 641 rays), and simulating realistic metal artifacts.
  • Clinical Data: Two clinical datasets were used for evaluation:
  • DL (DeepLesion): A subset of the DeepLesion dataset.
  • CL: CT scans from patients with metal rods and screws after spinal fusion. A total of 30 slices from DL and 10 slices from CL were selected, specifically those with significant metal artifacts.

Key Insights and Ideas

  • Geometry is Key: The paper strongly argues that simply knowing where metal is (binarized mask) is insufficient. Encoding the shape and projection of the metal (metal mask projection) is critical for accurate artifact reduction.
  • Don't Throw Away Data: Treating metal-affected sinogram regions as entirely missing leads to information loss and over-smoothing. Their method shows the benefit of learning to correct these regions while retaining geometric cues.
  • Sinogram Padding Matters: Standard zero-padding in CNNs can ignore the inherent periodicity of sinogram data. Their proposed periodic padding strategy improves performance, especially for larger metal objects.
  • Dual-Domain Synergy: Combining sinogram and image enhancement, guided by the metal mask projection, leads to more anatomically precise results than single-domain approaches.

Key Results

  • Quantitative Improvement: The proposed "Ours" model achieved significant improvements over state-of-the-art methods like DuDoNet. For example, they report a 4.2 dB PSNR gain and a 99.4% MSE reduction compared to CNNMAR on simulated data. The improvements are particularly pronounced for large metal implants.
  • Qualitative Improvement: Visual comparisons on both simulated and clinical data show that their method produces artifact-reduced images with sharper details and more accurate anatomical structures compared to other methods, which often result in over-smoothing, distortion, or residual artifacts.
  • Expert Evaluation: A radiologist rated the model's performance as significantly better than most competing methods, including DuDoNet, on clinical images.

Limitations and Future Work

  • 2D Limitation: The current model is designed for 2D CT geometry. The authors acknowledge that artifacts in 3D projection (like cone-beam CT) are more challenging and would require further development.
  • Metal Material Robustness: While they simulated titanium implants, they plan to retrain the model with multiple metal materials to enhance its robustness to different implant compositions.
  • Unknown Geometry: They aim to process images with unknown geometries by simulating them within the existing framework.
  • Large-Scale Clinical Study: A comprehensive clinical study is planned to further validate the approach's effectiveness in real-world clinical practice.

Summary updated

Abstract

Metal artifact reduction (MAR) in computed tomography (CT) is a notoriously challenging task because the artifacts are structured and non-local in the image domain. However, they are inherently local in the sinogram domain. Thus, one possible approach to MAR is to exploit the latter characteristic by learning to reduce artifacts in the sinogram. However, if we directly treat the metal-affected regions in sinogram as missing and replace them with the surrogate data generated by a neural network, the artifact-reduced CT images tend to be over-smoothed and distorted since fine-grained details within the metal-affected regions are completely ignored. In this work, we provide analytical investigation to the issue and propose to address the problem by (1) retaining the metal-affected regions in sinogram and (2) replacing the binarized metal trace with the metal mask projection such that the geometry information of metal implants is encoded. Extensive experiments on simulated datasets and expert evaluations on clinical images demonstrate that our novel network yields anatomically more precise artifact-reduced images than the state-of-the-art approaches, especially when metallic objects are large.
BibTeX
@inproceedings{lyu2020encoding,
  author = {Yuanyuan Lyu and Wei-An Lin and Haofu Liao and Jingjing Lu and S. Kevin Zhou},
  title = {{Encoding Metal Mask Projection for Metal Artifact Reduction in Computed Tomography}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2020},
  url = {https://openreview.net/forum?id=IaGZiOta5Ns},
}
Figure