Functional Adversarial Attacks

Cassidy Laidlaw, Soheil Feizi

TL;DR

Researchers have introduced functional adversarial attacks, a new threat model that perturbs all features of an input using a single global function (e.g., shifting all red pixels in an image simultaneously). By combining these global changes with traditional pixel-level tweaks, they created ReColorAdv, an attack that is less perceptible to humans but so potent it breaks even the most robustly defended machine learning models.

What Problem Does This Paper Address?

Most adversarial research focuses on the "$\ell_p$-ball" threat model, where an attacker changes individual pixels by a tiny, almost invisible amount. While effective in a lab setting, this model is narrow. It misses "global" perturbations—like changing the lighting of a scene or the "accent" of an audio clip—that are perfectly natural to human eyes but catastrophic for neural networks.

The authors argue that our current definition of "small perturbations" is too limited. A human might not notice if an entire image is slightly darkened or if its color palette is shifted, yet these changes can easily fool a classifier. The gap here is a lack of a formal framework for these uniform, feature-wide attacks and a way to combine them with existing methods to test the true limits of model robustness.

Methods: The Functional Threat Model

The paper introduces the Functional Threat Model. Instead of adding a unique noise value $\delta_i$ to each feature $x_i$, it applies a single function $f$ to every feature: $(x_1, \dots, x_n) \to (f(x_1), \dots, f(x_n))$.

Comparison of additive, functional, and combined adversarial attacks.

ReColorAdv

The primary implementation of this model is ReColorAdv, which targets image colors.

  1. Function Mapping: It uses a parameterized function to map an input color $c$ to a new color $f(c)$. To keep it computationally efficient, they define $f$ on a discrete grid of colors and use trilinear interpolation for everything in between.
  2. Regularization: To ensure the attack remains imperceptible, they apply two constraints:
  3. Spatial Bound ($F_{diff}$): No color can be moved further than a certain distance in color space.
  4. Smoothness ($F_{smooth}$): Similar colors must be perturbed in similar ways to avoid "color banding" or weird artifacts.
  5. Color Spaces: They found that performing the attack in the CIELUV color space (which is designed to be perceptually uniform to human vision) produces much more realistic results than the standard RGB space.
Examples of ReColorAdv attacks showing the original image, the adversarial image, and the amplified perturbation map.

The Power of Combination

The authors prove that combining a functional attack with a standard additive attack creates a threat model that is strictly more powerful than either one alone. They demonstrate this by composing ReColorAdv with delta attacks ($\ell_\infty$ noise) and StAdv (spatial flow attacks).

Key Insights and Results

The authors evaluated their attacks on CIFAR-10 (ResNet-32) and ImageNet (Inception-v4), revealing several critical vulnerabilities in current models:

  • Uniformity is Stealthy: Because functional attacks apply the same change everywhere, they preserve dependencies like shape boundaries and shading. This allows for much larger absolute changes than additive noise before a human notices.
  • Orthogonal Vulnerabilities: Robustness doesn't "transfer" well between attack types. A model trained to resist pixel noise (delta attacks) is still highly vulnerable to color shifts (ReColorAdv), and vice versa.
  • Breaking Defenses: On CIFAR-10, ReColorAdv alone reduced a standard ResNet-32's accuracy to just 3.0%.
  • Defeating TRADES: Even TRADES, one of the most respected defense methods at the time, saw its accuracy drop to 5.7% when faced with the combined ReColorAdv + StAdv + delta attack.
  • New State-of-the-Art Attack: The combination of ReColorAdv with other attacks resulted in the lowest accuracy ever reported for an adversarially trained model on CIFAR-10 (3.6% accuracy for a model trained specifically against that combination).
  • Perceptual Quality: Using the LPIPS metric (a measure of how humans perceive image similarity), the authors showed that their combined attacks often had lower perceptual distortion than single attacks, despite being more effective at fooling the model.

Limitations and Future Work

While the theory is general, the experiments are heavily focused on image color (ReColorAdv). Generating these combined attacks is also more computationally expensive than a simple FGSM or PGD attack, which might limit their use in real-time adversarial training.

However, the authors suggest that functional attacks could be highly effective in other domains, such as audio (changing pitch/volume) or NLP (systematic word substitutions). Ultimately, the paper highlights a massive gap in our current defense strategies: we need new types of adversarial training that account for functional perturbations to create truly reliable AI.

Summary updated

Abstract

We propose functional adversarial attacks, a novel class of threat models for crafting adversarial examples to fool machine learning models. Unlike a standard lp-ball threat model, a functional adversarial threat model allows only a single function to be used to perturb input features to produce an adversarial example. For example, a functional adversarial attack applied on colors of an image can change all red pixels simultaneously to light red. Such global uniform changes in images can be less perceptible than perturbing pixels of the image individually. For simplicity, we refer to functional adversarial attacks on image colors as ReColorAdv, which is the main focus of our experiments. We show that functional threat models can be combined with existing additive (lp) threat models to generate stronger threat models that allow both small, individual perturbations and large, uniform changes to an input. Moreover, we prove that such combinations encompass perturbations that would not be allowed in either constituent threat model. In practice, ReColorAdv can significantly reduce the accuracy of a ResNet-32 trained on CIFAR-10. Furthermore, to the best of our knowledge, combining ReColorAdv with other attacks leads to the strongest existing attack even after adversarial training.
BibTeX
@inproceedings{laidlaw2019functional,
  author = {Cassidy Laidlaw and Soheil Feizi},
  title = {{Functional Adversarial Attacks}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2019},
  url = {https://openreview.net/forum?id=T5pjlkbQ6fs},
}
Figure