Global Adversarial Attacks for Assessing Deep Learning Robustness

Hanbin Hu, Mit Shah, Jianhua Z. Huang, Peng LiarXiv 2019 · arXiv

Abstract

Current research in deep learning robustness primarily focuses on local adversarial attacks, which evaluate model behavior in the immediate vicinity of existing data points. This paper introduces Global Adversarial Attacks, a framework designed to assess model stability across the entire input space, including regions far from the training distribution. By identifying pairs of nearly identical inputs that yield divergent model predictions, the authors reveal that standard defenses against local attacks do not guarantee global robustness. Experimental results on MNIST and CIFAR-10 show that even "hardened" models remain highly vulnerable to these global instabilities.

Introduction: Beyond Local Robustness

Most adversarial research is centered on local robustness: given a specific input $x$ with a known label $y$, can we find a nearby $x'$ that the model misclassifies? While useful, this approach is insufficient for safety-critical applications like autonomous driving. Local attacks only examine regions near the training or testing sets, leaving the vast majority of the input space as a "black box." Furthermore, they require labeled data to function.

If a model encounters a visual pattern far removed from its training data, its behavior is unpredictable. We need to determine if the model's decision boundaries are unstable throughout the input space, not just near known samples.

Conceptual comparison of local and global adversarial examples relative to a learned decision boundary.

Methodology

The authors define a Global Adversarial Attack as the search for a pair of inputs $(x_1, x_2)$ that are visually indistinguishable (within a radius $\epsilon$) but result in different model predictions. Two primary methods are proposed:

  1. Alternating Gradient Attacks (G-PGD): An iterative approach where one point is fixed while the other is moved to maximize output divergence, followed by a swap. This allows the pair to "walk" through the input space toward regions of high instability.
  2. Extreme-Value-Guided MCMC (GEVMCMC): A stochastic approach leveraging Extreme Value Theory (EVT) and Markov Chain Monte Carlo (MCMC) sampling. This method explores the space more broadly to find diverse vulnerabilities that gradient-based methods might overlook.

To test these methods, the researchers used MNIST and CIFAR-10, augmented with an 11th class for "meaningless" random noise. This setup allows attacks to start from pure noise and observe if the model begins to perceive "meaningful" objects or sharp transitions between classes in empty space.

Results and Key Insights

The most striking finding is that local defense does not equal global robustness. Models trained using Projected Gradient Descent (PGD)—the current gold standard for local defense—remained nearly 100% vulnerable to global attacks.

  • Attack Success Rate: On both benchmarks, G-PGD and GEVMCMC achieved an attack rate of nearly 100%.
  • Failure of Adversarial Training: While local adversarial training reduced local attack success from 30% to 4% on MNIST, the Global PGD attack maintained a >99% success rate regardless of the defense applied.
  • Vulnerability is Ubiquitous: Attacks successfully found adversarial pairs starting from both legitimate images and random noise, suggesting that neural networks possess highly fractured decision boundaries even where no real data exists.
Global adversarial pairs found on the MNIST dataset, showing transitions from noise and between digits.

Conclusion

This work exposes a significant gap in current robustness evaluations. While local adversarial training provides a degree of protection near the data manifold, it fails to stabilize the model's behavior globally. Future work must focus on developing Global Adversarial Training algorithms and scaling these methods to higher-resolution datasets to ensure the reliability of deep learning systems in the wild.

Summary updated

Abstract

It has been shown that deep neural networks (DNNs) may be vulnerable to adversarial attacks, raising the concern on their robustness particularly for safety-critical applications. Recognizing the local nature and limitations of existing adversarial attacks, we present a new type of global adversarial attacks for assessing global DNN robustness. More specifically, we propose a novel concept of global adversarial example pairs in which each pair of two examples are close to each other but have different class labels predicted by the DNN. We further propose two families of global attack methods and show that our methods are able to generate diverse and intriguing adversarial example pairs at locations far from the training or testing data. Moreover, we demonstrate that DNNs hardened using the strong projected gradient descent (PGD) based (local) adversarial training are vulnerable to the proposed global adversarial example pairs, suggesting that global robustness must be considered while training robust deep learning networks.
BibTeX
@misc{hu2019global,
  author = {Hanbin Hu and Mit Shah and Jianhua Z. Huang and Peng Li},
  title = {{Global Adversarial Attacks for Assessing Deep Learning Robustness}},
  year = {2019},
  eprint = {1906.07920},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1906.07920},
}
Figure