Mutual Partial Label Learning with Competitive Label Noise

Yan Yan, Yuhong GuoICLR 2023 · OpenReview

TL;DR

This paper introduces ML-PLL, a framework designed for "Partial Label Learning" (PLL) where training data is labeled with a set of candidate labels rather than a single ground truth. Unlike previous methods that assume noise is random, ML-PLL specifically tackles "competitive noise"—distractors that look like the true label—by using a mutual learning strategy between a neural classifier and a prototype-based model, supported by a network that explicitly models label associations.

The Challenge of Competitive Label Noise

In many real-world scenarios, obtaining precise, unambiguous labels for training data is prohibitively expensive. Instead, we often rely on "partial labels." For instance, an image of an alpaca might be annotated with a candidate set like {alpaca, camel, llama}. The core challenge of Partial Label Learning (PLL) is disambiguation: identifying the single true label from this noisy set.

Most existing PLL research assumes that the "extra" labels (the noise) are chosen uniformly at random. However, in the real world, noise is often competitive. An annotator is much more likely to confuse an alpaca with a camel than with a toaster. When noisy labels are semantically or visually similar to the ground truth, standard algorithms struggle to tell them apart. This paper aims to bridge this gap by explicitly modeling these competitive relationships.

Proposed Method: ML-PLL

To address competitive noise, the authors propose ML-PLL (Mutual Learning based PLL). The architecture relies on three main pillars to iteratively disambiguate the candidate label sets.

Architecture of ML-PLL
  1. Interactive Mutual Learning: The system simultaneously trains two classifiers. The first is a standard deep prediction network. The second is a class-prototype-based classifier, which categorizes images based on how close their feature embeddings are to a "typical" learned example (prototype) of a class. These two "heads" share information to correct each other's mistakes, preventing the model from overfitting to specific noisy labels.
  2. Noisy Label Correction: Instead of blindly trusting the initial candidate set throughout training, the model generates "soft pseudo-labels" by combining the outputs of both classifiers. This dynamic correction helps the model gradually focus on the most likely true label while suppressing competitive distractors.
  3. Transformation Network ($T$): This unique component learns the association between true labels and candidate labels. It estimates a transition matrix $R$ that describes the probability of a label being included in a candidate set given the ground truth. By reconstructing the observed candidate labels, it helps the prediction network better isolate the underlying "clean" signal.

Key Insights

  • Modeling the "Why" of Noise: By using a transformation network, the model doesn't just try to find the true label; it attempts to understand the process that created the noisy label set. This provides a stronger regularizing effect during training.
  • Prototypes for Stability: Deep networks can easily "memorize" noise. By incorporating a class-prototype classifier, the model gains a more stable, global view of what each class looks like, steering the prediction network away from overfitting on confusing samples.
  • Efficiency via Moving Averages: Updating class prototypes across a whole dataset is computationally expensive. The authors implemented a batch-wise moving average update, making the framework scalable to large datasets without a massive performance hit.

Datasets and Key Results

The researchers evaluated their model on four widely used image benchmarks: Fashion-MNIST, Kuzushiji-MNIST, CIFAR-10, and CIFAR-100. To simulate competitive noise, they trained a separate model on clean data and selected the "top-K" most confusing incorrect labels to serve as the noisy candidates for each image.

ML-PLL demonstrated state-of-the-art (SOTA) performance across the board, with the most significant gains appearing in the most difficult scenarios.

Performance on competitive noise
  • CIFAR-10 (Competitive Noise): As shown in the results, with an average of 5 candidate labels, ML-PLL achieved 79.25% accuracy, significantly outperforming the previous SOTA, PiCO (76.42%).
  • CIFAR-100 (Competitive Noise): On this much harder dataset with 10 candidate labels, ML-PLL reached 53.53% accuracy, while PiCO trailed at 49.22%.
  • Ablation Studies: Removing the label correction component caused the largest drop in performance, proving that the interactive "self-correction" between the two classifiers is the engine of the model's success.

Limitations and Future Work

  • Synthetic vs. Real Noise: While the "top-K" method is a clever way to simulate competitive noise, it is still a synthetic process. Testing on datasets with naturally occurring human-annotated partial labels (like web-crawled data) would be a valuable next step.
  • Hyperparameter Sensitivity: The model relies on trade-off parameters to balance the different loss functions. The authors noted that performance is somewhat sensitive to the consistency loss weight, which might require careful tuning for new datasets.
  • Scaling to Massive Label Spaces: While it handled 100 classes well, it remains to be seen how the transformation matrix $R$ (which scales quadratically with the number of classes) performs on datasets with thousands of categories.

Summary updated

Abstract

Partial label learning (PLL) is an important weakly supervised learning problem, where each training instance is associated with a set of candidate labels that include both the true label and additional noisy labels. Most existing PLL methods assume the candidate noisy labels are randomly chosen, which hardly holds in real-world learning scenarios. In this paper, we consider a more realistic PLL scenario with competitive label noise that is more difficult to distinguish from the true label than the random label noise. We propose a novel Mutual Learning based PLL approach named ML-PLL to address this challenging problem. ML-PLL learns a prediction network based classifier and a class-prototype based classifier cooperatively through interactive mutual learning and label correction. Moreover, we use a transformation network to model the association relationships between the true label and candidate labels, and learn it together with the prediction network to match the observed candidate labels in the training data and enhance label correction. Extensive experiments are conducted on several benchmark PLL datasets, and the proposed ML-PLL approach demonstrates state-of-the-art performance for partial label learning.
BibTeX
@inproceedings{yan2023mutual,
  author = {Yan Yan and Yuhong Guo},
  title = {{Mutual Partial Label Learning with Competitive Label Noise}},
  booktitle = {International Conference on Learning Representations},
  year = {2023},
  url = {https://openreview.net/forum?id=EUrxG8IBCrC},
}
Figure