Introduction
Few-shot learning (FSL) aims to recognize new objects from a limited number of examples. While most FSL algorithms assume a pristine "base" dataset for pre-training, real-world data is often "dirty," containing feature noise from transmission or label noise from human error. FSL models are particularly sensitive to such corruption, often overfitting to noise rather than learning generalizable patterns. This paper introduces Peer-Collaboration Learning (PCL), a model-agnostic framework designed to filter out corrupted data and enhance robustness in noisy scenarios.
Methodology: Peer-Collaboration Learning (PCL)
The PCL framework is inspired by collaborative learning, where two interactive modules cross-examine training data to identify and down-weight problematic samples.
Architecture and Workflow
PCL consists of two modules that share a common feature extractor but utilize independent classification and importance-extraction heads. The process involves three key stages:
- Mutual Evaluation: Module A evaluates a batch and identifies "difficult" samples (high loss) for Module B, and vice-versa.
- Dual-Perspective Weighting: Sample importance is determined through two lenses:
- Global Weighting: A BiLSTM network ranks samples by loss values to identify global outliers.
- Local Weighting: A Transformer layer analyzes intra-class similarity to detect samples that deviate from the class prototype.
- Re-weighted Training: The calculated weights scale the loss of each sample, effectively filtering out corrupted data from gradient updates.
Experimental Evaluation
The framework was evaluated on four benchmarks: CIFAR-FS, CUB, mini-ImageNet, and tiered-ImageNet. To simulate real-world conditions, feature noise (random pixels) and label noise (mislabeled images) were injected at rates of 20% and 40%.
Key Results
PCL demonstrated significant performance gains across all tested baseline algorithms (MatchingNet, ProtoNet, S2M2, and DeepEMD). For instance, in 40% label noise scenarios on mini-ImageNet, PCL improved ProtoNet's accuracy by +5.27%.
Beyond noisy data, PCL also improved performance on clean datasets, suggesting it helps models focus on the most informative examples by filtering out inherent dataset ambiguities. Ablation studies confirmed that both global and local weighting are essential; global weighting excels at catching extreme noise, while local weighting is more effective for subtle mislabeling.
Conclusion and Future Work
PCL offers a robust, model-agnostic solution for few-shot learning under data corruption. While it introduces some computational overhead due to the dual-module architecture, its ability to generalize across various noise types and base algorithms is a significant advancement. Future research may focus on optimizing training efficiency and exploring deeper theoretical foundations for peer-collaboration in low-data regimes.
Summary updated