Identifying Mislabeled Data using the Area Under the Margin Ranking

Geoff Pleiss, Tianyi Zhang, Ethan R. Elenberg, Kilian Q. Weinberger

Deep neural networks are notoriously good at memorization. While this capacity allows them to learn complex patterns, it is also a massive liability: if training data contains incorrect labels, an overparameterized model will eventually learn to associate specific features with the wrong label. This results in overly specific filters that hurt the model's ability to generalize to new, correctly labeled data.

To address this, researchers have introduced the Area Under the Margin (AUM), a simple yet powerful statistic that identifies mislabeled training samples by observing their behavior during the training process. By adding a "fake" extra class to act as a threshold, this approach provides a plug-and-play method to prune noisy data, leading to significant accuracy boosts on both synthetic and real-world datasets.

The Problem with Mislabeled Data

Mislabeled data is ubiquitous, stemming from web-scraped datasets, human errors in crowdsourced labeling, and inherently ambiguous samples.

Examples of mislabeled and ambiguous training samples found in standard datasets.

Existing solutions to mitigate the impact of bad data often involve complex multi-stage pipelines or custom loss functions. Furthermore, many methods require a perfectly clean validation set to tune thresholds, which is not always available. The AUM method seeks a simpler metric that can identify these harmful samples dynamically without requiring massive architectural changes.

The Area Under the Margin (AUM) Method

The core contribution of the paper is the AUM statistic, which exploits the differences in training dynamics between clean and mislabeled samples.

  1. The Margin: For any given sample, the margin is the difference between the logit (the raw model output) of the assigned label and the highest logit among all other classes. Correct labels usually have a high, positive margin. Mislabeled samples, however, face a "tension": the model wants to generalize (predicting the true hidden class based on visual features) but is forced to memorize (predicting the wrong assigned label). This results in a low or even negative margin.
  2. AUM Statistic: Instead of looking at the margin at the end of training, AUM averages the margin across all training epochs. This captures how the model's confidence in a label evolves over time.
  3. The Thresholding Trick: To decide which samples to prune, the authors introduce an artificial extra class. They take a small portion of the training data and purposefully assign them to this fake class. Since these samples are guaranteed to be mislabeled, their AUM values serve as a natural, non-parametric threshold. Any original sample with an AUM lower than these "threshold samples" is flagged as mislabeled and removed.

Key Results and Insights

The researchers evaluated AUM on a mix of controlled datasets (CIFAR-10, CIFAR-100, and Tiny ImageNet with synthetic noise) and real-world weakly-labeled data (WebVision50 and Clothing100K).

  • Real-World Improvements: On the WebVision50 classification task, the AUM method flagged and removed 17.8% of the data, which yielded a 1.6% absolute improvement in test error.
  • Standard Benchmark Gains: On CIFAR-100, removing 13% of the data led to a 1.2% drop in error. Remarkably, in some CIFAR-100 experiments, removing data flagged by AUM resulted in a model that performed better than an "Oracle" model trained strictly on ground-truth clean data. This suggests AUM successfully identifies ambiguous data that confuses the model, not just outright mislabeled data.
  • High Precision and Recall: In high-noise scenarios (e.g., 80% synthetic noise), AUM achieved over 90% precision and recall in identifying corrupted samples, significantly outperforming baselines like INCV or DY-Bootstrap.
  • Auditing Curated Data: When applied to the highly curated ImageNet dataset, AUM flagged about 2% of the samples. While removing them didn't significantly change accuracy due to the dataset's already high quality, it provided a highly effective shortlist of suspicious samples for manual auditing.

Limitations and Future Directions

While highly effective, the AUM method has a few limitations. If the noise is extremely systematic (e.g., every instance of a bird is labeled as a dog), the "tension" in training dynamics disappears because the model lacks correct examples to generalize from, causing AUM's recall to drop. Additionally, the method requires an initial training run to compute the AUM values before the final model can be trained on the cleaned data, introducing some computational overhead.

Looking forward, AUM could be utilized for more than just data pruning. The authors suggest it could inform curriculum learning strategies, where a model learns from "easy" (high AUM) samples before tackling "hard" (low AUM) ones, further optimizing the training of deep neural networks.

Summary updated

Abstract

Not all data in a typical training set help with generalization; some samples can be overly ambiguous or outrightly mislabeled. This paper introduces a new method to identify such samples and mitigate their impact when training neural networks. At the heart of our algorithm is the Area Under the Margin (AUM) statistic, which exploits differences in the training dynamics of clean and mislabeled samples. A simple procedure - adding an extra class populated with purposefully mislabeled threshold samples - learns a AUM upper bound that isolates mislabeled data. This approach consistently improves upon prior work on synthetic and real-world datasets. On the WebVision50 classification task our method removes 17% of training data, yielding a 1.6% (absolute) improvement in test error. On CIFAR100 removing 13% of the data leads to a 1.2% drop in error.
BibTeX
@inproceedings{pleiss2020identifying,
  author = {Geoff Pleiss and Tianyi Zhang and Ethan R. Elenberg and Kilian Q. Weinberger},
  title = {{Identifying Mislabeled Data using the Area Under the Margin Ranking}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2020},
  url = {https://openreview.net/forum?id=5ZWGHuPSOf},
}
Figure