TL;DR
This paper reveals that noisy labels in graph classification tasks don't just degrade model accuracy—they also significantly increase the risk of privacy leaks through membership inference attacks. To combat this, the authors introduce RGLC, a robust framework that uses principal component analysis and dual-view label correction to filter noise and protect data privacy without sacrificing performance.
What Problem Does This Paper Address?
Graph Neural Networks (GNNs) are powerful tools for classifying complex data like molecular structures or social networks. However, they are notoriously sensitive to "noisy labels"—training data where the category assigned to a graph is incorrect.
While previous research has focused on how noise hurts a model's utility (its accuracy), this paper highlights a critical second dimension: privacy. The authors demonstrate that noisy labels cause models to overfit, creating a "memorization" effect that makes it much easier for an attacker to determine if a specific data point was part of the training set (a Membership Inference Attack, or MIA). Most existing solutions for noisy labels are designed for images or node-level tasks and fail to address the unique structural complexities and privacy risks inherent in graph-level classification.
Methods
The authors propose the Robust Graph Neural Network Approach with Noisy Labeled Graph Classification (RGLC), which consists of three main stages:
- Two-Stage Noise Selection:
- Stage 1: It uses the "small loss" criterion (the idea that models learn clean patterns before noisy ones) to identify a set of high-confidence samples.
- Stage 2: It performs Singular Value Decomposition (SVD) on these high-confidence samples to find the "first principal component vector" for each class. Clean samples typically align closely with this vector, while noisy ones do not, allowing for precise filtering.
- Dual-View Label Correction: Instead of just discarding noisy samples, RGLC tries to fix them. It combines information from two "views": the embedding space (how well a sample aligns with the class principal components) and the output space (the model's prediction on perturbed versions of the graph).
- Supervised Graph Contrastive Learning: Finally, the model uses the corrected labels to pull similar graphs together and push different ones apart in the embedding space. This makes the model's internal representations more robust and harder for privacy attackers to exploit.
Datasets
The RGLC method was evaluated on eight widely used graph classification benchmarks, spanning bioinformatics and social networks:
- Bioinformatics: MUTAG, NCI1, PTC, COX2, PROTEINS, and PROTEINS_F.
- Social Networks: IMDB-B and IMDB-M.
The researchers simulated noisy environments by randomly flipping labels at rates ranging from 10% to 50%.
Key Insights and Ideas
- The Overfitting-Privacy Link: The paper confirms that noisy labels exacerbate overfitting. As shown in Figure 1, the gap between training and testing performance widens as noise increases, which directly translates to higher success rates for privacy attacks.
- Embeddings are More Robust than Outputs: In large datasets, the model's final output layer often becomes highly confused by noise. However, the authors found that the internal "embeddings" (the mathematical representations of the graphs) remain surprisingly discriminative. This is why RGLC focuses on the embedding space for noise filtering.
- Contrastive Learning as a Shield: By enforcing "alignment and uniformity" in the embedding space through supervised contrastive learning, the model reduces the semantic variability that attackers use to identify training members.
Key Results
RGLC consistently outperformed twelve other state-of-the-art methods across all eight datasets.
- Utility: At a 30% noise rate, RGLC achieved performance gains between 0.8% and 7.8% over the previous best method (OMG).
- Privacy: The framework successfully reduced the accuracy of membership inference attacks to below 60%, significantly mitigating the privacy risks introduced by noise.
As illustrated in Figure 2, the RGLC method helps close the "accuracy gap" that typically signals a high risk of privacy leakage.
Limitations and Future Work
The authors identify two main areas for improvement:
- Class-Dependent Noise: The current study focuses on "class-independent" noise (random flips). In the real world, noise is often "class-dependent" (e.g., two similar-looking molecules are frequently mislabeled as each other), which is harder to filter.
- White-Box Attack Gap: While RGLC is highly effective against black-box attacks, defending against "white-box" attacks—where the attacker has access to the model's internal parameters—remains a challenge at very high noise levels (e.g., 50%).
Future research will focus on enhancing the model's robustness in these more extreme and complex noise scenarios.
Summary updated