Cross-Stained Segmentation from Renal Biopsy Images Using Multi-Level Adversarial Learning

Ke Mei, Chuang Zhu, Lei Jiang, Jun Liu, Yuanyuan Qiao

Abstract

Accurate segmentation of glomeruli in renal biopsy images is essential for diagnosing kidney diseases like IgA nephropathy. However, variations in chemical staining protocols (e.g., PASM vs. Masson) create a significant "domain shift" that degrades the performance of standard deep learning models. This paper presents a Multi-level Deep Adversarial Network designed to achieve robust cross-stained segmentation. By employing mirrored domain-adversarial discriminators and a shape-based prior, the proposed framework effectively transfers knowledge from a labeled source stain to an unlabeled target stain, achieving high accuracy even in unsupervised scenarios.

Introduction

In clinical nephrology, pathologists utilize various chemical stains to highlight different tissue structures. Periodic Acid-Silver Methenamine (PASM) provides high contrast for basement membranes, while Masson’s Trichrome is used to identify fibrosis. For automated image analysis, this diversity presents a challenge: a model trained on one stain often fails when applied to another due to differences in color, texture, and noise. Manually annotating large datasets for every new staining protocol is prohibitively expensive. This research addresses the problem of domain adaptation, seeking to maintain segmentation performance across different stains without requiring extensive new labels.

Proposed Architecture

The core of the proposed solution is a Multi-level Deep Adversarial Network that aligns features across domains at multiple scales. The architecture consists of three primary components:

  1. Segmentation Network (G): A U-Net-based generator with a ResNet-34 backbone that produces the initial segmentation masks.
  2. Mirrored Domain-Adversarial Discriminators ($D_e$ and $D_d$): To handle the domain shift, the authors introduced discriminators that "mirror" the encoder and decoder structures of the U-Net. These discriminators attempt to identify the stain type from feature maps at various layers. By training the generator to "fool" these discriminators, the model learns domain-invariant features that capture underlying biological structures rather than stain-specific visual noise.
  3. Shape-Adversarial Discriminator ($D_s$): To ensure biological plausibility, a ResNet-18 discriminator distinguishes between predicted masks and real ground-truth masks. This acts as a geometric prior, forcing the model to favor the generally round shapes characteristic of glomeruli.
The Multi-level Deep Adversarial Network architecture with mirrored discriminators.

Experimental Setup and Datasets

The study utilized two distinct clinical datasets of renal biopsy images:

  • Source Domain (S): 416 images stained with PASM.
  • Target Domain (T): 403 images stained with Masson.

Images were captured at 100x, 200x, and 400x magnifications and annotated by expert pathologists. The framework was evaluated in both supervised settings (labels available for both domains) and unsupervised domain adaptation (UDA) settings (labels available only for the source PASM images).

Results and Discussion

The multi-level approach proved superior to single-layer alignment methods. The authors found that early layers are highly sensitive to appearance variations (color/texture), while deeper layers capture semantic information. Aligning both is critical for robustness.

Key performance metrics included:

  • Supervised Performance: The full model (SDA-sed) achieved a Dice Coefficient (DC) of 90.49% on Masson-stained images.
  • Unsupervised Performance: In the UDA setting, the model achieved a DC of 87.73% on the target domain. This result is particularly significant as it approaches the supervised upper bound despite having zero labels for the Masson stain during training.
  • Stability: The model maintained high accuracy (over 95%) across both domains, indicating that it does not suffer from catastrophic forgetting of the source domain while adapting to the target.
Examples of glomeruli segmentation across various biopsy samples.

The inclusion of the shape discriminator ($D_s$) was vital for the unsupervised results. By providing a "roundness" anchor, the model was prevented from misidentifying noisy background textures in the Masson stain as glomerular structures.

Conclusion

This work demonstrates that multi-level adversarial learning, combined with mirrored architectures and biological shape priors, can effectively bridge the stain gap in renal pathology. The ability to perform high-accuracy segmentation in an unsupervised manner significantly reduces the annotation burden for clinical AI deployment. Future research may explore extending this framework to more diverse staining sets (such as H&E) and more complex, non-spherical pathological structures.

Summary updated

Abstract

Segmentation from renal pathological images is a key step in automatic analyzing the renal histological characteristics. However, the performance of models varies significantly in different types of stained datasets due to the appearance variations. In this paper, we design a robust and flexible model for cross-stained segmentation. It is a novel multi-level deep adversarial network architecture that consists of three sub-networks: (i) a segmentation network; (ii) a pair of multi-level mirrored discriminators for guiding the segmentation network to extract domain-invariant features; (iii) a shape discriminator that is utilized to further identify the output of the segmentation network and the ground truth. Experimental results on glomeruli segmentation from renal biopsy images indicate that our network is able to improve segmentation performance on target type of stained images and use unlabeled data to achieve similar accuracy to labeled data. In addition, this method can be easily applied to other tasks.
BibTeX
@inproceedings{mei2020cross,
  author = {Ke Mei and Chuang Zhu and Lei Jiang and Jun Liu and Yuanyuan Qiao},
  title = {{Cross-Stained Segmentation from Renal Biopsy Images Using Multi-Level Adversarial Learning}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2020},
  url = {https://openreview.net/forum?id=9KXFeTa5eL7b},
}
Figure