Towards Accuracy-Fairness Paradox: Adversarial Example-based Data Augmentation for Visual Debiasing

Yi Zhang, Jitao Sang

TL;DR

This paper introduces AEDA (Adversarial Example-based Data Augmentation), a method that uses adversarial attacks to balance training data distributions. By generating "pseudo-samples" that decouple target features from biased attributes (like gender or background color), the researchers successfully break the "accuracy-fairness paradox," improving both model fairness and predictive performance simultaneously.

What Problem Does This Paper Address?

In machine learning, we often face a frustrating trade-off: making a model "fairer" (reducing bias against protected groups) usually results in lower overall accuracy. This is the Accuracy-Fairness Paradox.

Most existing debiasing techniques fall into three camps:

  1. Pre-processing: Re-sampling or re-weighting data (often loses information).
  2. In-processing: Adding constraints during training (often restricts the model's representative power).
  3. Post-processing: Tweaking outputs after the fact (doesn't fix the underlying model).

The authors argue that the root cause of bias is imbalanced data distribution. For example, if a dataset contains many more "females with arched eyebrows" than "males with arched eyebrows," a model will lazily learn to use gender as a shortcut for the facial feature. The challenge is that collecting perfectly balanced real-world data is often impossible or prohibitively expensive.

Methods

The authors propose Adversarial Example-based Data Augmentation (AEDA). Instead of searching for rare real-world images, they use adversarial perturbations to "create" them.

The Core Logic

If you have a "female with arched eyebrows" image, an adversarial attack can slightly perturb the pixels so the model sees it as "male," while the "arched eyebrows" feature remains visually and structurally intact. These generated images serve as synthetic training data to fill the gaps in the distribution.

Three Flavors of AEDA:

  • AEDA_pre: Generates adversarial examples once before training.
  • AEDA_online: Couples the target classifier training with adversarial generation. As the model's feature extractor evolves, the adversarial examples are updated to ensure they remain challenging and informative. This maintains cross-task transferability—ensuring the "male" features in the adversarial image actually help the "arched eyebrow" classifier stay unbiased.
  • AEDA_robust: The "complete" version. It adds an adversarial training module to the bias classifier. By making the bias classifier more robust, the generated adversarial examples contain more generalized, high-level features of the minority group rather than just "pixel noise."

Datasets

The researchers evaluated their approach on two distinct scenarios:

  1. C-MNIST (Simulated Bias): A modified MNIST dataset where digits 0–4 are associated with red backgrounds and 5–9 with brown. The goal is to recognize the digit regardless of the background color.
  2. CelebA (Real-world Bias): A massive dataset of facial attributes. The authors used 34 facial attributes (like "big nose" or "smiling") as target tasks and "gender" as the biased variable. They specifically filtered the data to ensure no person appeared in both training and testing sets to prevent identity-based leakage.

Key Insights and Ideas

  • Adversarial Examples as Features: Contrary to the view that adversarial perturbations are just "bugs," this paper builds on the idea that they contain "non-robust features" that models use. AEDA harnesses these to represent minority classes that are underrepresented in the raw data.
  • The Importance of "Online" Coupling: The authors discovered that if you generate adversarial examples once (offline), the model eventually learns to ignore them as the feature extractor updates. By generating them "online" during training, the data augmentation stays synchronized with the model's current state.
  • Breaking the Paradox: Most debiasing methods act as a "penalty" on the model. AEDA acts as a "supplement." By providing more (synthetic) data, the model has more opportunities to learn the correct features, which naturally leads to higher accuracy alongside better fairness.

Key Results

The results demonstrate that AEDA consistently outperforms standard debiasing methods like Adversarial Debiasing and CycleGAN.

  • C-MNIST: The original biased model had a balanced average accuracy (bACC) of 55.62%. AEDA_robust boosted this to 91.80% while slashing model bias from 7.84 to 0.53.
  • CelebA: AEDA_robust achieved the highest bACC (74.30%) and the lowest model bias (3.27) among all tested methods. Notably, traditional "Down-sampling" reduced bias significantly but tanked accuracy (66.35% bACC), highlighting the superiority of the augmentation approach.
  • Few-Shot Potential: In a preliminary test, using AEDA for few-shot learning (training on very few samples) resulted in a 27% improvement over the baseline, suggesting this method is a viable alternative to traditional data collection.

Limitations and Future Work

While the results are promising, the paper notes a few areas for further exploration:

  • Computational Cost: Generating adversarial examples online for every epoch is more computationally expensive than standard training or offline augmentation.
  • Human Interpretability: The generated "pseudo-samples" are optimized for the model's feature space, not necessarily for human eyes. While they work for training, they don't provide a "visual explanation" of the minority group.
  • Scaling to Complex Biases: The study focused on binary bias variables (like gender or color). Future work could investigate how this scales to multi-class or continuous biased variables (like age or skin tone).

Summary updated

Abstract

Machine learning fairness concerns about the biases towards certain protected or sensitive group of people when addressing the target tasks. This paper studies the debiasing problem in the context of image classification tasks. Our data analysis on facial attribute recognition demonstrates (1) the attribution of model bias from imbalanced training data distribution and (2) the potential of adversarial examples in balancing data distribution. We are thus motivated to employ adversarial example to augment the training data for visual debiasing. Specifically, to ensure the adversarial generalization as well as cross-task transferability, we propose to couple the operations of target task classifier training, bias task classifier training, and adversarial example generation. The generated adversarial examples supplement the target task training dataset via balancing the distribution over bias variables in an online fashion. Results on simulated and real-world debiasing experiments demonstrate the effectiveness of the proposed solution in simultaneously improving model accuracy and fairness. Preliminary experiment on few-shot learning further shows the potential of adversarial attack-based pseudo sample generation as alternative solution to make up for the training data lackage.
BibTeX
@inproceedings{zhang2020towards,
  author = {Yi Zhang and Jitao Sang},
  title = {{Towards Accuracy-Fairness Paradox: Adversarial Example-based Data Augmentation for Visual Debiasing}},
  booktitle = {ACM Multimedia},
  year = {2020},
  url = {https://openreview.net/forum?id=Bzru7tlcO5},
}

Loading related content...

Figure