Introduction
Automating the analysis of biopsy slides through histopathology is a critical advancement for modern medicine. However, the field faces a significant "data bottleneck." Training robust deep learning models typically necessitates thousands of images meticulously labeled by expert pathologists—a process that is prohibitively expensive, time-consuming, and fraught with privacy concerns.
While foundation models like CONCH offer zero-shot capabilities, their performance in specialized medical domains often falls short of clinical requirements. Fine-tuning these models with minimal data (e.g., one-shot learning) frequently results in overfitting, where the model memorizes specific examples rather than learning generalizable features. Furthermore, many existing few-shot methods are computationally intensive, hindering deployment on standard hospital hardware.
Methodology
To address these challenges, we present Co-HSF (Co-filtered Histopathology Semi-Supervised Few-Shot), a framework designed to adapt large histopathology foundation models using only one labeled example per class.
The architecture is built upon three core components:
- Dual-SSFSL Training Loop: The system employs a "Teacher" and a "Student" model, both utilizing the CONCH vision encoder, a state-of-the-art model pre-trained specifically on pathology data.
- Co-filtering (CF) Pseudo-labeling: This mechanism allows the model to utilize vast amounts of unlabeled clinical data. A pseudo-label is only assigned to an unlabeled image if both the Teacher and Student models reach a consensus across both the original and augmented versions of the image. This "double-check" strategy effectively filters out the noisy labels that often degrade semi-supervised learning performance.
- Inductive Inference: Unlike transductive methods that require access to unlabeled data during prediction, Co-HSF trains a standalone classifier head. This approach bypasses the need for text encoding at test time, significantly reducing computational overhead.
Experimental Results
The framework was evaluated on two major benchmarks: NCT-CRC-HE (100,000 colorectal cancer patches) and PatchCamelyon (327,000 breast cancer patches).
- Performance Gains: On the 9-class NCT dataset, Co-HSF achieved 90.1% accuracy with just one labeled sample per class, a dramatic improvement over the 51.7% accuracy of the zero-shot CONCH baseline.
- Efficiency: Co-HSF demonstrated a 53% increase in inference speed compared to zero-shot approaches.
- Resource Optimization: The model's memory footprint was reduced to 952 MiB of VRAM, significantly lower than the 2200+ MiB required by standard foundation model adaptation methods. This efficiency facilitates deployment on modest clinical hardware.
- Robustness: Co-HSF showed lower performance variability across different random seeds, indicating high stability regardless of the specific one-shot sample selected.
Discussion and Conclusion
Co-HSF demonstrates that model consistency is a powerful proxy for ground truth in low-data regimes. By enforcing agreement across different model architectures and data augmentations, the framework successfully leverages unlabeled data without propagating errors. Furthermore, the transition from vision-language comparison to direct visual classification streamlines the inference pipeline, making high-performance histopathology analysis accessible in resource-constrained environments. Future work will focus on addressing class imbalance and evaluating the model's performance across diverse, multi-center clinical datasets.
Summary updated