Unsupervised Domain Adaptation with Shape Constraint and Triple Attention for Joint Optic Disc and Cup Segmentation

Fengming Zhang, Shuiwang Li, Jianzhi Deng

TL;DR

This paper introduces SCUDA, a novel unsupervised domain adaptation framework for segmenting the optic disc and cup in fundus images. SCUDA addresses the common issue of performance degradation due to domain shift by incorporating a shape constraint loss function that leverages the inherent circularity of these anatomical structures, and a convolutional triple attention module to enhance feature representation.

What Problem Does This Paper Address?

Glaucoma, a leading cause of blindness, is often detected by measuring the cup-to-disc ratio (CDR) from fundus images. Accurate segmentation of the optic disc and optic cup is crucial for this measurement. While deep learning models have shown promise, their performance often suffers from "domain shift" – when the characteristics of the training data differ significantly from the test data (e.g., different imaging devices or protocols). Existing domain adaptation methods can sometimes produce anatomically unrealistic segmentation results. This paper aims to improve the robustness and accuracy of optic disc and cup segmentation in the face of domain shift, specifically by preventing malformed segmentation outputs.

Methods

The proposed SCUDA framework builds upon the IOSUDA (Input and Output Space Unsupervised Domain Adaptation) pipeline. Its key innovations are:

  • Shape-Constrained Loss Function (Lshape): This novel loss function embeds domain-invariant prior knowledge about the shape of the optic disc and cup. Recognizing that these structures are typically circular or near-circular, the loss penalizes segmentations that deviate from this expected shape. It quantifies shape deviation by measuring the mean deviation of distances from contour points to their centroid, normalized by the mean distance. This helps ensure that the predicted segmentation regions are anatomically plausible.
  • Convolutional Triple Attention Module (CTAM): To further enhance the segmentation network (a U-Net architecture), the authors integrate a CTAM. This module is designed to capture cross-dimensional interactions (between channels and spatial dimensions) within the feature maps. It uses a three-branch structure with rotations and pooling to generate attention weights, which are then used to refine the feature representations. This aims to improve the network's ability to focus on relevant features and boost segmentation accuracy.

The framework also includes an image translation sub-model for aligning source and target domain features and a segmentation sub-model optimized with adversarial learning.

Datasets

The experiments were conducted using three publicly available fundus imaging datasets:

  • RIM-ONE_r3: Used as a target domain.
  • Drishti-GS: Used as a target domain.
  • REFUGE: Used as the source domain for training.

The paper notes that RIM-ONE_r3 is more challenging due to a more severe domain shift compared to Drishti-GS.

Key Insights and Ideas

  • Shape as a Powerful Prior: The paper highlights that the inherent geometric shape of anatomical structures (like the circular optic disc and cup) is a valuable, domain-invariant prior that can significantly improve segmentation robustness, especially in unsupervised domain adaptation settings.
  • Addressing Malformed Segmentations: A key motivation is to overcome the tendency of some domain adaptation methods to produce unrealistic shapes. The shape constraint directly tackles this by enforcing anatomical plausibility.
  • Efficient Attention for U-Net: The CTAM offers an effective way to enhance U-Net's feature representation capabilities by capturing complex cross-dimensional interactions without introducing excessive parameters or additional loss functions, which is crucial for limited medical imaging datasets.
  • Synergy of Shape and Attention: The SCUDA framework demonstrates that combining shape constraints with advanced attention mechanisms leads to superior performance compared to using either component alone.

Key Results

SCUDA achieved state-of-the-art performance on both the RIM-ONE_r3 and Drishti-GS datasets.

  • Quantitative Improvements: On RIM-ONE_r3, SCUDA outperformed the second-best method (IOSUDA) by significant margins in IoUOD (1.83%), IoUoc (2.02%), DiceOD (1.66%), and Diceoc (1.73%). Similar improvements were observed on the Drishti-GS dataset.
  • Qualitative Improvements: Visual comparisons showed that SCUDA produced smoother and more accurate segmentation contours, especially in challenging cases with unclear boundaries, compared to other methods like SIFA and IOSUDA. The shape constraint was credited for these more realistic results.
  • Ablation Studies:
    • An ablation study on the weight of the shape constraint loss indicated that a moderate weight (around 1.0) yielded the best overall performance, suggesting that overly strong constraints can be detrimental.
  • Another ablation study confirmed the effectiveness of both the shape constraint loss and the CTAM module. Individually, each component improved upon the baseline IOSUDA, but their combination in SCUDA yielded the best results.

Limitations and Future Work

  • Approximate Shape Assumption: The authors acknowledge that the shape constraint is based on an "approximate assumption" of circularity, which might not be strictly true for all cases.
  • Future Directions:
    • Investigating more realistic shape assumptions for constructing constraints.
  • Developing more effective and efficient attention mechanisms for U-Net.
  • Exploring novel frameworks for unsupervised domain adaptation.

Summary updated

Abstract

Currently, glaucoma has become an important cause of blindness. At present, although glaucoma cannot be cured, early treatment can prevent it from getting worse. A reliable way to detect glaucoma is to segment the optic disc and cup and then measure the cup-to-disc ratio (CDR). Many deep neural network models have been developed to autonomously segment the optic disc and the optic cup to help in diagnosis. However, their performance degrades when subjected to domain shift. While many domain-adaptation methods have been exploited to address this problem, they are apt to produce malformed segmentation results. In this study, it is suggested that the segmentation network be adjusted using a constrained formulation that embeds prior knowledge about the shape of the segmentation areas that is domain-invariant. Based on IOSUDA (i.e., Input and Output Space Unsupervised Domain Adaptation), a novel unsupervised joint optic cup-to-disc segmentation framework with shape constraints is proposed, called SCUDA (short for Shape-Constrained Unsupervised Domain Adaptation). A shape constrained loss function is novelly proposed in this paper which utilizes domain-invariant prior knowledge concerning the segmentation region of the joint optic cup–optical disc of fundus images to constrain the segmentation result during network training. In addition, a convolutional triple attention module is designed to improve the segmentation network, which captures cross-dimensional interactions and provides a rich feature representation to improve the segmentation accuracy. Experiments on the RIM-ONE_r3 and Drishti-GS datasets demonstrate that the algorithm outperforms existing approaches for segmenting optic discs and cups.
BibTeX
@inproceedings{zhang2022unsupervised,
  author = {Fengming Zhang and Shuiwang Li and Jianzhi Deng},
  title = {{Unsupervised Domain Adaptation with Shape Constraint and Triple Attention for Joint Optic Disc and Cup Segmentation}},
  booktitle = {Sensors},
  year = {2022},
  url = {https://openreview.net/forum?id=BDJttcvTGPI},
}
Figure