Noise Transfer for Unsupervised Domain Adaptation of Retinal OCT Images

Valentin Koch, Olle G. Holmberg, Hannah Spitzer, Johannes Schiefelbein, Ben Asani, Michael Hafner, Fabian J. Theis

TL;DR

This paper introduces SVDNA, a simple yet effective unsupervised domain adaptation method for retinal OCT images. By transferring the noise characteristics of target devices to source images, SVDNA significantly improves segmentation accuracy across different OCT scanners without requiring new labels, outperforming more complex state-of-the-art methods.

What Problem Does This Paper Address?

Medical imaging modalities like Optical Coherence Tomography (OCT) are crucial for diagnosing and monitoring eye diseases. However, OCT images captured by different devices exhibit domain shifts due to variations in image quality, noise levels, and contrast. These shifts can drastically reduce the performance of machine learning models trained on data from one device when applied to data from another. Manually annotating data from every device is prohibitively expensive and time-consuming. Therefore, there's a pressing need for unsupervised domain adaptation (UDA) techniques that can bridge this domain gap without requiring additional labeled data.

Methods

The core of this work is the Singular Value Decomposition-based Noise Adaptation (SVDNA) method. SVDNA leverages the observation that noise structure is a key differentiator between OCT devices. The method works by decomposing both source and target images into their singular value components (U, Σ, Vᵀ). It then reconstructs the source image using its "content" components (first k singular values and vectors) and adds the "noise" components (remaining singular values and vectors) from the target image. This effectively transfers the noise characteristics of the target domain to the source image, creating a "restyled" image.

Crucially, SVDNA is designed to be minimal and easily integrated into existing segmentation pipelines. It doesn't require modifying the underlying network architecture or training a separate, complex style transfer model like CycleGAN. After restyling, the source images with their original labels can be used to train a segmentation network, enabling it to generalize to unseen target domains. A histogram matching step is also applied to further align pixel intensity distributions.

Datasets

The paper utilizes a private source domain dataset of 462 macular OCT scans from a Spectralis device, annotated with 14 classes according to the AAO Consensus Nomenclature.

For evaluation, they use publicly available datasets from the RETOUCH challenge, which include images from Cirrus and Topcon devices. They also incorporate a dataset with images from a Bioptigen device. These datasets are used for both training and quantitative evaluation, with annotations from the RETOUCH challenge used solely for performance assessment.

Key Insights and Ideas

  • Noise as the Key Domain Shift: The authors highlight that the noise structure, rather than just overall image appearance, is a critical factor in domain shift for OCT images. SVDNA directly targets this by transferring noise characteristics.
  • Simplicity is Powerful: SVDNA demonstrates that a minimal, noise-focused adaptation method can be highly effective, even outperforming more complex UDA techniques. This challenges the notion that complex architectures are always necessary for domain adaptation.
  • Seamless Integration: The ease of integrating SVDNA into existing augmentation pipelines is a significant practical advantage, making it readily adoptable by researchers and practitioners.
  • Unsupervised Adaptation for Medical Imaging: The work showcases the potential of UDA for critical medical applications like OCT segmentation, where labeled data is scarce and expensive.

Key Results

  • Competitive Performance: SVDNA consistently outperforms a baseline network (no domain adaptation) and compares favorably to or even surpasses state-of-the-art UDA methods like FDA, CRST, and CycleGAN on the RETOUCH challenge datasets.
  • Outperforms Supervised Methods: On a non-public test set from the RETOUCH challenge, SVDNA achieved the second-best result among 10 submitted segmentation methods on the Topcon dataset and the sixth-best on the Cirrus dataset, significantly improving over the naive baseline and performing competitively with fully supervised models.
  • Effective Style Transfer: Figure 2 demonstrates visually how SVDNA successfully restyles images from the Spectralis device to match the characteristics of Topcon, Cirrus, and Bioptigen devices. Figure 2b further shows that the noise embeddings of restyled images align closely with target domains.

Limitations and Future Work

  • Directionality of Adaptation: The authors acknowledge that SVDNA might not perform as well when adapting from a low-noise domain (like Spectralis) to a high-noise domain. They suggest that test-time SVDNA style transfer, where noise is added to low-noise images before prediction, could be a solution.
  • Content Distortion with Complex Methods: They note that more complex methods like CycleGAN can sometimes slightly alter image content or fail entirely, which can be detrimental for segmenting subtle OCT biomarkers.
  • Limited Dataset Size for Self-Training: The paper mentions that self-training-based UDA methods did not perform well in their experiments, potentially due to the limited size of the datasets.

Future work could explore more robust noise transfer mechanisms, investigate the opposite direction of domain adaptation (high-noise to low-noise), and further refine the integration of SVDNA with other advanced segmentation architectures.

Summary updated

Abstract

Optical coherence tomography (OCT) imaging from different camera devices causes challenging domain shifts and can cause a severe drop in accuracy for machine learning models. In this work, we introduce a minimal noise adaptation method based on a singular value decomposition (SVDNA) to overcome the domain gap between target domains from three different device manufacturers in retinal OCT imaging. Our method utilizes the difference in noise structure to successfully bridge the domain gap between different OCT devices and transfer the style from unlabeled target domain images to source images for which manual annotations are available. We demonstrate how this method, despite its simplicity, compares or even outperforms state-of-the-art unsupervised domain adaptation methods for semantic segmentation on a public OCT dataset. SVDNA can be integrated with just a few lines of code into the augmentation pipeline of any network which is in contrast to many state-of-the-art domain adaptation methods which often need to change the underlying model architecture or train a separate style transfer model. The full code implementation for SVDNA will be made available at https://github.com/ValentinKoch/SVDNA .
BibTeX
@inproceedings{koch2022noise,
  author = {Valentin Koch and Olle G. Holmberg and Hannah Spitzer and Johannes Schiefelbein and Ben Asani and Michael Hafner and Fabian J. Theis},
  title = {{Noise Transfer for Unsupervised Domain Adaptation of Retinal OCT Images}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2022},
  url = {https://openreview.net/forum?id=qSIzNyjibER},
}
Figure