Anonymizing k Facial Attributes via Adversarial Perturbations

Saheb Chhabra, Richa Singh, Mayank Vatsa, Gaurav Gupta

Abstract

This paper introduces a novel algorithm that utilizes adversarial perturbations—essentially "invisible noise"—to selectively hide specific facial attributes, such as gender or age, from automated AI classifiers. Unlike previous methods that degrade image quality or erase a person's identity, this approach successfully anonymizes chosen traits while keeping the image visually unchanged and the individual recognizable for face-matching systems.

Introduction

In the age of social media and ubiquitous data analytics, a single face image reveals far more than just identity. Automated systems can now predict "soft biometrics" such as gender, race, age, and even sensitive traits like sexual orientation with high accuracy. This creates a significant privacy risk for individuals who want to share their photos but don't want to be profiled.

Conceptual overview of selective facial attribute anonymization.

Existing solutions for "attribute suppression" often fall short. Techniques like blurring or pixelation make images unusable for human viewing. More advanced methods, such as face morphing, often destroy the original identity information or cause significant visual distortions. Furthermore, most existing tools lack a "control" mechanism to selectively hide some attributes while preserving others (e.g., hiding gender but keeping a specific facial expression).

Methodology

The authors propose a framework for k-attribute anonymization using adversarial perturbations. The core idea is to add a mathematically calculated, imperceptible layer of noise to the image that "fools" an attribute classification model into making an incorrect prediction.

The researchers formulated an objective function that minimizes three things simultaneously:

  1. Visual Distortion: The $L_2$ distance between the original and modified image.
  2. Attribute Classification: The probability of the "true" class for the target attributes, pushing the classifier toward a wrong result.
  3. Identity Preservation: The distance between identity features of the original and modified images to ensure face recognition systems still work.

The optimization utilizes the Adam optimizer and a $tanh$ function to ensure the resulting pixel values remain within a valid range (0 to 1). The method is designed to handle three distinct scenarios: suppressing a single attribute, suppressing multiple attributes while preserving others, and suppressing attributes while strictly maintaining identity information.

Experimental Evaluation

The algorithm was evaluated on three widely used facial image benchmarks:

  • MUCT: 3,755 images of 276 subjects, captured under varying lighting conditions.
  • LFWcrop: A cropped version of the "Labeled Faces in the Wild" dataset, used primarily for testing identity preservation.
  • CelebA: A massive dataset of over 200,000 celebrity images, used to test the suppression of complex, multiple attributes (e.g., "Attractive," "Smiling," "Heavy Makeup").

Results and Discussion

The proposed method demonstrates that adversarial noise can be a proactive privacy tool. By disentangling identity and attributes, it is possible to modify the features a neural network uses to determine "gender" or "age" without significantly affecting the features used to determine "identity."

Comparison of original and perturbed images across various attributes and datasets.

Key Performance Metrics

  • Effective Suppression: On the CelebA dataset, the accuracy of an "Attractive" attribute classifier plummeted from 89.31% to 0.28% after the perturbation was applied.
  • Total Anonymization: In tests on the MUCT dataset, the proposed method achieved a 0% accuracy for the true gender class, completely flipping the classifier's output.
  • Identity Preservation: Using Cumulative Match Characteristic (CMC) and Receiver Operating Characteristic (ROC) curves, the authors showed that the "anonymized" images performed almost identically to the original images in face-matching tasks.
  • Visual Fidelity: Qualitative results show that the modified images are virtually indistinguishable from the originals to the human eye, avoiding the "uncanny valley" or blurriness of previous methods.

Conclusion

While the results are impressive, the paper primarily focuses on white-box attacks for attribute suppression. Future work is needed to explore the robustness of attribute anonymization against unknown or "ensemble" classifiers (black-box scenarios). Additionally, the resilience of these perturbations against standard image processing—such as heavy JPEG compression, resizing, or social media filters—remains an area for further exploration to ensure real-world applicability.

Summary updated

Abstract

A face image not only provides details about the identity of a subject but also reveals several attributes such as gender, race, sexual orientation, and age. Advancements in machine learning algorithms and popularity of sharing images on the World Wide Web, including social media websites, have increased the scope of data analytics and information profiling from photo collections. This poses a serious privacy threat for individuals who do not want to be profiled. This research presents a novel algorithm for anonymizing selective attributes which an individual does not want to share without affecting the visual quality of images. Using the proposed algorithm, a user can select single or multiple attributes to be surpassed while preserving identity information and visual content. The proposed adversarial perturbation based algorithm embeds imperceptible noise in an image such that attribute prediction algorithm for the selected attribute yields incorrect classification result, thereby preserving the information according to user's choice. Experiments on three popular databases i.e. MUCT, LFWcrop, and CelebA show that the proposed algorithm not only anonymizes k-attributes, but also preserves image quality and identity information.
BibTeX
@inproceedings{chhabra2018anonymizing,
  author = {Saheb Chhabra and Richa Singh and Mayank Vatsa and Gaurav Gupta},
  title = {{Anonymizing k Facial Attributes via Adversarial Perturbations}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2018},
  doi = {10.24963/ijcai.2018/91},
}
Figure