Learned Regularization for Sparse-View CT: Accuracy, Lesion Detectability and Distribution Shift of a Plug-and-Play Prior against Tuned Total Variation

Mohammed Abo OraigarXiv 2026 · arXiv

TL;DR

This paper puts "learned priors"—neural networks used to guide image reconstruction—to the test against traditional mathematical methods like Total Variation (TV) in sparse-view CT. The results show that while learned priors often win on standard metrics like PSNR when the data looks like their training set, they are highly sensitive to "distribution shift" and can even perform worse than traditional methods at the critical task of detecting lesions.

What Problem Does This Paper Address?

Reconstructing a clear CT image from "sparse-view" data (fewer X-ray angles or lower radiation doses) is an ill-posed inverse problem. There isn't enough information in the measurements alone to create a perfect image, so we rely on a prior—a set of assumptions about what a "normal" image should look like—to fill in the gaps.

Traditionally, we used hand-crafted mathematical priors like Total Variation (TV), which assumes images are mostly smooth with sharp edges. Recently, researchers have replaced these with learned priors: neural networks trained on thousands of existing CT scans. However, these are usually evaluated using pixel-wise metrics like Peak Signal-to-Noise Ratio (PSNR) on data very similar to their training set.

The author asks three critical questions:

  1. Does the learned prior still win when the image type changes (distribution shift)?
  2. Does it "hallucinate" structures (like lesions) that aren't actually there?
  3. Do these conclusions hold up across different noise levels and real-world clinical data?

Methods

The study focuses on the Plug-and-Play (PnP) framework. Instead of training a massive end-to-end network for a specific scanner, PnP takes a pre-trained denoiser (in this case, a DnCNN) and "plugs" it into a standard iterative reconstruction algorithm.

Key methodological rigors included:

  • Fair Baselines: Every method (FBP, Tikhonov, and TV) was meticulously tuned on validation data for every single condition.
  • Lesion-Insertion Protocol: To move beyond PSNR, the author inserted synthetic "lesions" (blobs) into images to see which method actually helped a "lesion observer" (a mathematical model of a radiologist) find them.
  • Distribution Shift Testing: Training a prior on MNIST (digits) but testing it on Fashion-MNIST (clothing) or the Shepp-Logan phantom to simulate real-world scenarios where a patient might have an unexpected pathology.

Datasets

  • Synthetic: MNIST (digits), Fashion-MNIST (clothing), EMNIST (letters), and the Shepp-Logan phantom.
  • Real-world: LoDoPaB-CT, a large dataset of human chest CT slices. The study used a patient-disjoint split (training on some patients, testing on entirely different ones) across three angle counts (30, 60, 120) and three dose levels.

Key Insights and Ideas

  • PSNR is a Poor Proxy for Utility: A reconstruction can have a higher PSNR (lower pixel error) but a lower AUC (Area Under the Curve) for lesion detection. In some cases, the learned prior "smoothed over" small lesions to achieve a better PSNR, effectively hiding the most important clinical information.
  • The "Prior Mismatch" Penalty: When the test data didn't match the training data, the learned prior's performance plummeted. An MNIST-trained prior trying to reconstruct a Shepp-Logan phantom performed 4.3–4.6 dB worse than simple TV.
  • Hallucinations are Real: Under distribution shift, the learned prior created "lesion-like" false blobs significantly more often than TV (0.43 vs 0.03 per image). It essentially tried to force the unknown data to look like the digits it was trained on.
  • TV is a Formidable Baseline: When properly tuned for the specific noise and angle count, traditional TV remains highly competitive, especially in its ability to avoid creating false structures.

Key Results

  • On Digits: A matched prior (trained and tested on digits) beat TV by 3.4 dB. However, when shifted to Fashion-MNIST, it lost to TV by 3.1 dB.
  • On Real CT (LoDoPaB): The learned prior did not consistently beat a well-tuned TV in PSNR (ranging from -0.93 to +0.33 dB difference).
  • Lesion Detection: On real CT slices, the learned prior actually detected small, high-contrast lesions better than the PSNR-tuned TV. However, it was never significantly better than simple Hann-filtered Filtered Back-Projection (FBP), suggesting that the "tuning" of TV for PSNR might actually be hurting its diagnostic utility.

Limitations and Future Work

  • Scope of Architecture: The study only evaluated one relatively small denoiser (DnCNN). Larger, more modern architectures (like Transformers or Diffusion-based priors) might be more robust.
  • Exploratory Nature: The CT analysis was developed after seeing initial results, meaning it lacks the weight of a pre-specified primary comparison.
  • Future Directions: The author suggests that future research should always include "mismatched" priors as a control and prioritize task-based metrics (like lesion detection) over pixel-wise metrics like PSNR and SSIM.

Summary updated

Abstract

Learned image priors are often proposed to replace hand-crafted regularizers in sparse-view computed tomography (CT), yet they are usually judged by PSNR on data resembling their training set. We evaluate one noise-conditioned DnCNN denoiser used as a Plug-and-Play prior against filtered back-projection (FBP), Tikhonov and total-variation (TV) regularization, with every method tuned on validation data and all differences paired. On synthetic 28x28 digit images, the prior beats box-constrained TV by about 3.4 dB at moderate noise (sigma = 0.05, 20 angles), but the advantage shrinks at low noise and reverses under distribution shift: an MNIST-trained prior is 3.1 dB (Fashion-MNIST) and 4.3-4.6 dB (Shepp-Logan phantom) below TV, whereas a Fashion-MNIST-trained prior beats TV by 2.2 dB on Fashion-MNIST, consistent with prior mismatch rather than a failure of PnP itself. In a lesion-insertion test the prior detects lesions worse than TV in distribution despite its higher PSNR, and under mismatch it produces more lesion-like false blobs than box-constrained TV for seven of eight lesion types. On real LoDoPaB-CT slices (patient-disjoint split; 30, 60 and 120 angles; three dose levels; 40 test patients), the prior does not consistently outperform a well-tuned TV in PSNR (-0.93 to +0.33 dB) and has lower SSIM in eight of nine conditions. Its lesion-detection AUC is higher than this TV's in all nine conditions (significant in six) but never significantly higher than that of Hann-filtered FBP, which the PSNR-tuned TV falls below in detection in all nine conditions (seven significant). On non-anatomical phantoms its PSNR falls below TV in all six conditions. PSNR and lesion detectability thus rank the methods differently. Our conclusions concern one small denoiser, and the CT analysis was developed after seeing results, without pre-specified primary comparisons.
BibTeX
@misc{oraig2026learned,
  author = {Mohammed Abo Oraig},
  title = {{Learned Regularization for Sparse-View CT: Accuracy, Lesion Detectability and Distribution Shift of a Plug-and-Play Prior against Tuned Total Variation}},
  year = {2026},
  eprint = {2611.18936},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.18936},
}
Figure