Feasibility of Inconspicuous GAN-generated Adversarial Patches against Object Detection

Svetlana Pavlitskaya, Bianca-Marina Codau, J. Marius Zöllner

Introduction

Deep Neural Networks (DNNs) have revolutionized object detection, yet they remain vulnerable to adversarial attacks. Among these, adversarial patches—localized, high-contrast images placed within a camera's field of view—are particularly potent. However, traditional patches often consist of chaotic, "rainbow-colored" patterns that are easily detected by human observers. This research explores the feasibility of creating "inconspicuous" adversarial patches using Generative Adversarial Networks (GANs). The goal is to produce patches that appear as natural objects, such as flowers, while effectively "blinding" detectors like YOLOv3 to nearby objects.

Methodology

The study evaluates two primary strategies for generating stealthy adversarial patches:

1. Combined Patch-GAN Training

In this approach, a GAN is trained or fine-tuned simultaneously with an adversarial objective. The generator is tasked with creating a patch that satisfies two conditions: it must appear realistic to a discriminator network and it must maximize the loss of a target object detector.

2. Latent Space Optimization of Pretrained Generators

Rather than training a GAN from scratch, the authors utilize high-capacity pretrained models such as BigGAN or DCGAN. By searching the latent space of these models, the researchers optimize a noise vector to produce an image that functions as an adversarial patch. This method leverages the generator's existing "knowledge" of natural image distributions to ensure the resulting patch remains visually coherent.

To enhance robustness against environmental variations, the authors incorporate patch transformations during the optimization process. These include random adjustments to brightness and contrast, as well as the addition of digital noise. The Projected Gradient Descent (PGD) algorithm is employed to iteratively refine the patches.

Experimental Setup

The effectiveness of the patches was tested against the YOLOv3 detector using the COCO (Common Objects in Context) dataset, focusing on classes such as person, car, and bicycle. To train the GANs for naturalistic output, the Flower Recognition Dataset (~4,242 images) was used for DCGAN, while BigGAN relied on its original ImageNet pretraining.

A key distinction in this research is the focus on "non-overlapping" attacks. Unlike traditional attacks where a patch must cover the target object, these GAN-generated patches are designed to suppress detections of objects located in the vicinity of the patch, rather than directly underneath it.

Results and Analysis

The experiments demonstrate a significant impact on detector performance while maintaining visual stealth.

  • Baseline Performance: Without any attack, the YOLOv3 detector achieved a Mean Average Precision (mAP) of 43.8% on the COCO subset.
  • Conspicuous vs. Inconspicuous: Traditional "noisy" patches reduced the mAP to 3.4%. In comparison, the inconspicuous BigGAN-generated patches achieved a nearly identical reduction, bringing the mAP down to 4.1%.
  • Class-Specific Impact: The attacks were particularly effective against certain categories. For instance, the Average Precision (AP) for the car class plummeted from 7.9% to a mere 0.3% when the BigGAN patch was introduced.

The results indicate that searching the latent space of a pretrained model like BigGAN is superior to training smaller models like DCGAN from scratch. The high-capacity prior of BigGAN helps keep the adversarial search within the manifold of realistic images, effectively balancing the trade-off between realism and adversarial potency.

Discussion and Limitations

While the digital results are compelling, several challenges remain for real-world deployment. The current study utilized fixed patch placement; future iterations could optimize placement to further enhance inconspicuousness. Additionally, the transition from digital optimization to physical printing involves variables such as camera angles, lighting, and print quality that were not fully explored here. Finally, the computational intensity of optimizing high-capacity models like BigGAN may limit real-time generation.

Conclusion

This research confirms that adversarial patches do not need to be visually jarring to be effective. By utilizing GANs and latent space optimization, it is possible to create naturalistic patches that significantly degrade object detection performance. This highlights a critical security vulnerability in DNNs: the ability for an attacker to hide objects in plain sight using seemingly benign environmental elements.

Summary updated

Abstract

Standard approaches for adversarial patch generation lead to noisy conspicuous patterns, which are easily recognizable by humans. Recent research has proposed several approaches to generate naturalistic patches using generative adversarial networks (GANs), yet only a few of them were evaluated on the object detection use case. Moreover, the state of the art mostly focuses on suppressing a single large bounding box in input by overlapping it with the patch directly. Suppressing objects near the patch is a different, more complex task. In this work, we have evaluated the existing approaches to generate inconspicuous patches. We have adapted methods, originally developed for different computer vision tasks, to the object detection use case with YOLOv3 and the COCO dataset. We have evaluated two approaches to generate naturalistic patches: by incorporating patch generation into the GAN training process and by using the pretrained GAN. For both cases, we have assessed a trade-off between performance and naturalistic patch appearance. Our experiments have shown, that using a pre-trained GAN helps to gain realistic-looking patches while preserving the performance similar to conventional adversarial patches.
BibTeX
@inproceedings{pavlitskaya2022feasibility,
  author = {Svetlana Pavlitskaya and Bianca-Marina Codau and J. Marius Zöllner},
  title = {{Feasibility of Inconspicuous GAN-generated Adversarial Patches against Object Detection}},
  booktitle = {AISafety @ IJCAI},
  year = {2022},
  url = {https://openreview.net/forum?id=wB5CBBfjDDx},
}
Figure