Can Label-Specific Features Help Partial-Label Learning?

Ruo-Jing Dong, Jun-Yi Hang, Tong Wei, Min-Ling Zhang

Introduction

In the field of machine learning, Partial-Label Learning (PLL) addresses scenarios where training data is "inexact." Instead of a single ground-truth label, each instance is associated with a set of candidate labels, only one of which is correct. For instance, an image of a "dog" might be labeled with the set {dog, cat, fox}. Traditionally, PLL research has focused on "label disambiguation"—the process of identifying the true label within the candidate set to then train a standard classifier.

However, most existing PLL methods utilize a uniform feature space for all classes. This paper argues that such an approach is suboptimal. In many domains, specific features are more discriminative for certain classes than others (e.g., texture for "silk" vs. color for "ocean"). While Label-Specific Features (LSF) have proven effective in multi-label learning, they were previously difficult to apply to PLL because LSF typically requires known ground-truth labels to group data for feature extraction. This paper introduces UCL (UnCertainty-aware Label-specific features), a framework designed to overcome this hurdle.

The UCL Framework

The UCL framework shifts the focus from label space cleaning to feature space enhancement through a five-step process:

  1. Graph-Based Label Enhancement: To compensate for missing ground-truth labels, UCL uses a graph-based approach to generate "soft" pseudo-labels (probabilities) based on instance similarity in the original feature space.
  2. Uncertainty-Aware Partitioning: This is the core innovation. For each class, the data is partitioned into three regions based on confidence thresholds:
  3. Positive ($P$): High confidence the label is correct.
  4. Negative ($N$): High confidence the label is incorrect.
  5. Uncertain ($U$): Confusing samples that might otherwise introduce noise if forced into $P$ or $N$.
  6. Spectral Clustering: The framework performs spectral clustering on these three sets to identify "prototypes" (cluster centers) representing the essence of each region.
  7. Feature Transformation: Original features are transformed into a new space based on the distance of an instance to these class-specific prototypes.
  8. Classification: A family of binary classifiers is trained on these specialized, enhanced features.

Experimental Evaluation

The researchers evaluated UCL against eight state-of-the-art baselines using both synthetic and real-world datasets:

  • Synthetic Datasets: Five UCI datasets (zoo, glass, yeast, tmc2007, sport) were adapted for PLL by adding false positive labels with varying degrees of difficulty.
  • Real-World Datasets: Five diverse datasets were used, including Lost and Soccer Player (face naming), MSRCv2 and Mirflickr (image classification), and BirdSong (audio classification).

Key Results and Analysis

UCL demonstrated decisive superiority over existing methods. On real-world datasets, UCL outperformed baselines in 85% to 95% of tested cases. A significant finding was the effectiveness of the "Uncertain" buffer; ablation studies showed that the three-way split (Positive, Negative, Uncertain) was significantly more effective than a standard binary split, as it prevents ambiguous data from degrading the feature generation process.

Comparison of UCL against state-of-the-art PLL methods across five synthetic datasets.

Furthermore, the framework proved robust to varying hyperparameter settings. Analysis of the positive and negative thresholds ($\tau_h, \tau_l$) and other parameters showed that UCL maintains stable performance across a wide range of values, confirming its practical applicability.

Sensitivity analysis of UCL performance with respect to key hyperparameters across different datasets.

Conclusion

UCL demonstrates that enhancing the input representation through label-specific features can be more effective than simply attempting to clean output labels in PLL. By explicitly handling uncertainty during feature extraction, UCL provides a robust and versatile strategy that can be integrated with various existing PLL algorithms. Future work may involve leveraging deep neural networks to automate the generation of these label-specific features, potentially moving toward end-to-end deep learning architectures.

Summary updated

Abstract

Partial label learning (PLL) aims to learn from inexact data annotations where each training example is associated with a coarse candidate label set. Due to its practicability, many PLL algorithms have been proposed in recent literature. Most prior PLL works attempt to identify the ground-truth labels from candidate sets and the classifier is trained afterward by fitting the features of examples and their exact ground-truth labels. From a different perspective, we propose to enrich the feature space and raise the question ``Can label-specific features help PLL?'' rather than learning from examples with identical features for all classes. Despite its benefits, previous label-specific feature approaches rely on ground-truth labels to split positive and negative examples of each class and then conduct clustering analysis, which is not directly applicable in PLL. To remedy this problem, we propose an uncertainty-aware confidence region to accommodate false positive labels. We first employ graph-based label enhancement to yield smooth pseudo-labels and facilitate the confidence region split. After acquiring label-specific features, a family of binary classifiers is induced. Extensive experiments on both synthesized and real-world datasets are conducted and the results show that our method consistently outperforms eight baselines. Our code is released at https://github.com/meteoseeker/UCL
BibTeX
@inproceedings{dong2023can,
  author = {Ruo-Jing Dong and Jun-Yi Hang and Tong Wei and Min-Ling Zhang},
  title = {{Can Label-Specific Features Help Partial-Label Learning?}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2023},
  doi = {10.1609/aaai.v37i6.25904},
}
Figure