Unsupervised Domain Adaptation for Low-Dose CT Reconstruction via Bayesian Uncertainty Alignment

Kecheng Chen, Jie Liu, Renjie Wan, Victor Ho-Fun Lee, Varut Vardhanabhuti, Hong Yan, Haoliang Li

TL;DR

This paper introduces a novel unsupervised domain adaptation (UDA) method for low-dose CT (LDCT) reconstruction. By leveraging Bayesian neural networks, it aligns uncertainty distributions in the latent space and sharpness in the image space, significantly improving reconstruction quality on unseen target domains without requiring paired target data.

What Problem Does This Paper Address?

Low-dose CT (LDCT) imaging is crucial for reducing patient radiation exposure while maintaining diagnostic image quality. However, deep learning (DL) models trained on specific datasets (source domain) often perform poorly when applied to real-world clinical data (target domain) due to variations in acquisition protocols, scanner hardware, and other factors. This "domain shift" is a major hurdle for deploying these models in clinical practice. Existing unsupervised domain adaptation (UDA) methods for LDCT reconstruction struggle with two key issues: 1) they often lack uncertainty quantification, which is vital for reliable medical systems, and 2) direct alignment can lead to content mismatch problems when comparing images from different patients or scanners.

Methods

The authors propose a Bayesian neural network (BNN)-based framework for LDCT reconstruction that addresses these challenges through a joint discrepancy minimization approach in both latent and image spaces.

  • Bayesian Uncertainty Alignment (BUA) in Latent Space: Instead of deterministic models, they use a BNN encoder and decoder. To quantify and reduce the "epistemic gap" (model's ignorance) between source and target domains, they devise an uncertainty discrepancy minimization loss. This loss leverages the covariance matrix of latent features derived from multiple Monte Carlo (MC) samples. A self-reconstruction loss is also introduced to ensure invertible latent representations for the target domain.
  • Sharpness-Aware Distribution Alignment (SDA) in Image Space: To mitigate content mismatch issues arising from unpaired data, they propose aligning the "sharpness" of reconstructed images. This is achieved by using the Maximum Local Variation (MLV) descriptor, which captures high-frequency content, and then employing an adversarial learning approach with a discriminator to match the MLV distributions between source NDCT and target reconstructed images.

Datasets

The authors used the following datasets:

  • AAPM-16 Dataset (Source Domain): A widely-adopted benchmark dataset for LDCT reconstruction, providing simulated LDCT/NDCT image pairs with noise corresponding to approximately 25% of normal dose.
  • AAPM-A Dataset (Target Domain): Simulated by adding mixed Poisson-Gaussian noise to NDCT images from AAPM-16, representing a higher noise scenario (approx. 5% dose).
  • AAPM-B Dataset (Target Domain): Simulated with milder noise interference than the source domain (approx. 5% dose, but higher PSNR than AAPM-A).
  • ISICDM-20 Dataset (Target Domain): A clinical dataset of low-dose CT images, representing real-world variations in CT manufacturer, reconstruction kernel, and pixel spacing.

Key Insights and Ideas

  • Uncertainty as a Key to Domain Adaptation: The paper highlights that model uncertainty, quantified by Bayesian methods, is a strong indicator of out-of-distribution data and can be directly leveraged to improve domain adaptation performance.
  • Latent Space Alignment for Robustness: Aligning uncertainty in the latent space is more effective than direct image-space alignment for handling domain shifts, as it captures more abstract representations.
  • Sharpness for Content-Invariant Alignment: Using sharpness (second-order image information) as a descriptor for distribution alignment effectively bypasses the problem of content mismatch between source and target domains, which is a common issue with style-based alignment.
  • BNNs for Trustworthy Medical AI: The work underscores the importance of BNNs in medical imaging for providing not just high-quality reconstructions but also uncertainty estimates, which can aid clinical decision-making.

Key Results

The proposed method, "Backbone+DA (Ours)," consistently outperformed various baseline methods (including traditional methods like BM3D, ONLM, and DL-based methods like CycleGAN, UDA, CCDnet) across all tested datasets and metrics.

  • Quantitative Performance: On the AAPM-A dataset, the proposed method achieved a PSNR of 32.68 dB and SSIM of 0.8726, significantly outperforming other methods. Similar improvements were observed on AAPM-B and ISICDM-20 datasets. For instance, on AAPM-B, it achieved a PSNR of 35.11 dB and SSIM of 0.9455.
  • Qualitative Performance: Visual comparisons showed that the proposed method effectively suppressed noise while preserving structural details and texture, producing results that closely resemble normal-dose CT images. The uncertainty maps also indicated reduced uncertainty in critical regions compared to the baseline.
  • Ablation Studies: The paper demonstrated that both Bayesian Uncertainty Alignment (BUA) and Sharpness-Aware Distribution Alignment (SDA) modules contribute significantly to the overall performance. The covariance matrix-based uncertainty quantification was found to be more effective than first-order statistics.

Limitations and Future Work

  • MFVI Assumption: The paper acknowledges that the mean-field variational inference (MFVI) assumption, which uses a fully factorized Gaussian posterior, might limit the expressiveness of the posterior distribution.
  • Future Work: The authors suggest investigating more flexible and expressive approximate posteriors (e.g., normalizing flows) to overcome the MFVI limitation and potentially achieve further performance improvements. They also mention exploring more efficient MC sampling strategies for reduced computational cost.

Summary updated

Abstract

Low-dose computed tomography (LDCT) image reconstruction techniques can reduce patient radiation exposure while maintaining acceptable imaging quality. Deep learning (DL) is widely used in this problem, but the performance of testing data (also known as target domain) is often degraded in clinical scenarios due to the variations that were not encountered in training data (also known as source domain). Unsupervised domain adaptation (UDA) of LDCT reconstruction has been proposed to solve this problem through distribution alignment. However, existing UDA methods fail to explore the usage of uncertainty quantification, which is crucial for reliable intelligent medical systems in clinical scenarios with unexpected variations. Moreover, existing direct alignment for different patients would lead to content mismatch issues. To address these issues, we propose to leverage a probabilistic reconstruction framework to conduct a joint discrepancy minimization between source and target domains in both the latent and image spaces. In the latent space, we devise a Bayesian uncertainty alignment to reduce the epistemic gap between the two domains. This approach reduces the uncertainty level of target domain data, making it more likely to render well-reconstructed results on target domains. In the image space, we propose a sharpness-aware distribution alignment (SDA) to achieve a match of second-order information, which can ensure that the reconstructed images from the target domain have similar sharpness to normal-dose CT (NDCT) images from the source domain. Experimental results on two simulated datasets and one clinical low-dose imaging dataset show that our proposed method outperforms other methods in quantitative and visualized performance. © 2024 IEEE.
BibTeX
@article{chen2024unsupervised,
  author = {Kecheng Chen and Jie Liu and Renjie Wan and Victor Ho-Fun Lee and Varut Vardhanabhuti and Hong Yan and Haoliang Li},
  title = {{Unsupervised Domain Adaptation for Low-Dose CT Reconstruction via Bayesian Uncertainty Alignment}},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2024},
  doi = {10.1109/tnnls.2024.3409573},
}
Figure