Introduction
Digital pathology relies heavily on the accurate identification and segmentation of cell nuclei for cancer diagnosis and grading. While deep learning has significantly advanced this field, existing supervised methods require extensive manual annotations, which are costly and time-consuming. Conversely, unsupervised methods often struggle with "degenerated" cancerous tissues where nuclei overlap or exhibit irregular morphologies. This paper introduces the Mutual-Complementing Framework (MCF), designed to achieve high-accuracy nuclei detection and segmentation using only a minimal set of initial templates.
The Mutual-Complementing Framework (MCF)
The MCF operates through a synergistic feedback loop between a detection branch and a segmentation branch, allowing the system to iteratively refine its performance without massive labeled datasets.
Detection and Segmentation Branches
The Detection Branch utilizes correlation filters (CF) to identify patterns matching a few initial nucleus templates. To handle varying scales and dense clusters, it employs Multi-scale and Cropped Filter Fusion (MFF & CFF). A key component is Gradient Direction Based Postprocessing (GDBP), which accurately separates overlapping nuclei by analyzing outward-pointing gradients from nucleus centers.
The Segmentation Branch consists of a U-Net architecture. Initially, it uses the high-confidence response maps from the detection branch as pseudo-masks for training.
The Feedback Loop
The core innovation lies in the bidirectional information flow:
- Detection → Segmentation: The detection branch provides initial targets for the CNN to learn.
- Segmentation → Detection: The CNN identifies nuclei missed by the initial filters. By calculating the "Mask Residual"—the difference between CNN predictions and filter detections—the system extracts new templates to update the detection branch for subsequent iterations.
Experimental Evaluation
The framework was validated on several public datasets (TNBC, MICCAI18, NuCLS) and a custom benchmark of 50 degenerated cancerous samples.
Key Results and Robustness
MCF demonstrates remarkable efficiency, achieving performance comparable to fully supervised models like Mask R-CNN and U-Net using only 10–16 initial templates. Crucially, MCF maintains high performance on difficult, degenerated samples where traditional unsupervised methods typically fail. While other methods saw performance drops of over 20% on messy clinical samples, MCF's performance remained stable with only a ~6% decrease.
Conclusion
The Mutual-Complementing Framework bridges the gap between data-hungry supervised learning and less robust unsupervised methods. By leveraging the strengths of correlation filters and CNNs through a residual-based feedback loop, MCF provides a scalable and robust solution for nuclei analysis in complex pathological environments.
Summary updated