Patch Attack for Automatic Check-out

Aishan Liu, Jiakai Wang, Xianglong Liu, Chongzhi Zhang, Bowen Cao, Hang YuarXiv 2020 · OpenReview

Abstract

Adversarial examples are inputs with imperceptible perturbations that easily mislead deep neural networks (DNNs). Recently, adversarial patches—where noise is confined to a small, localized area—have emerged as a practical threat in real-world scenarios. However, existing strategies often fail to generate patches with strong generalization across different classes or unseen items. This paper proposes a bias-based framework to generate class-agnostic universal adversarial patches. By exploiting both perceptual (texture) and semantic (prototype) biases of models, the proposed method achieves high attack success rates with minimal data. Extensive experiments in both digital and physical-world Automatic Check-out (ACO) scenarios demonstrate that this framework outperforms state-of-the-art methods.

Introduction

Automatic Check-out (ACO) systems, such as those used in Amazon Go or various retail mobile applications, rely heavily on Deep Neural Networks (DNNs) for item identification. While efficient, these systems are vulnerable to adversarial patches: small, printable stickers that, when placed on a product, cause the AI to misclassify it.

Most existing adversarial patches are either input-specific or require vast datasets to achieve universality. Furthermore, they typically struggle to generalize to "unseen" products—items not included in the attacker's training set. This research introduces a class-agnostic universal patch that is data-efficient and highly effective even against novel product categories.

Methodology

The proposed framework exploits two inherent biases in DNNs to create a potent universal attack.

Overview of the adversarial patch generation and attack scenario.

1. Perceptually Biased Prior Generation

DNNs are known to be biased toward local textures rather than global shapes. The researchers identify "hard examples"—images that reside near the model's decision boundaries—and extract their textural features using style loss (via Gram matrices) and uncertainty loss (entropy). An attention module then identifies the most influential pixels to form a "textural prior," providing a foundation for the patch that is already close to the model's failure points.

2. Training with Semantically Biased Prototypes

To reduce dependency on large-scale real-world datasets, the authors utilize "prototypes." These are synthetic images designed to represent the quintessential features of a class by maximizing the model's internal class-wise preference. Training on these distilled semantic features proves more effective than using raw images.

3. Robustness via Transformation

To ensure the patch remains effective in physical environments, an "Expectation of Transformation" module is used during training. This simulates various real-world conditions, including rotations, distortions, and lighting changes.

Experimental Setup

The framework was evaluated using:

  • RPC (Retail Product Checkout): The largest dataset for retail ACO, containing 200 product categories and over 83,000 images.
  • Real-World Platforms: Physical patches were tested against the image recognition systems of Taobao and JD, two of the world's largest e-commerce platforms.

Key Results and Discussion

The proposed method demonstrated significant superiority over existing benchmarks in both digital and physical settings.

Physical adversarial patches applied to various retail products.
  • Digital Performance: On a ResNet-152 model, the patch reduced Top-1 accuracy to just 5.42%, compared to 21.10% for AdvPatch and 38.89% for PSGAN.
  • Black-box Transferability: The attack remained potent against models it was not trained on, dropping AlexNet's accuracy to 31.68%.
  • Physical-World Efficacy: When printed and applied to items, the patch dropped the accuracy of the Taobao app to 56.25% and the JD app to 55.00%. Common items like milk were misidentified as "decorations" or "aluminum foil."
  • Generalization to Unseen Classes: Even when attacking product categories not present during training, the patch reduced model accuracy to 7.23%.

Insights on Model Vulnerability

The research highlights that texture is a significant "Achilles' heel" for DNNs. Because models prioritize local texture, patches mimicking confusing textures are highly effective. Additionally, the study found that training on 1,000 synthetic prototypes yielded better results than 10,000 real images, suggesting that distilled semantic features are a more efficient vector for universal attacks.

Conclusion

This work demonstrates a highly effective and generalized attack on ACO systems by exploiting model biases. While it exposes critical vulnerabilities, it also provides a roadmap for developing more robust AI. Future research may focus on de-emphasizing textural features during model training to close the perceptual bias loophole exploited by these adversarial patches.

Summary updated

Abstract

Adversarial examples are inputs with imperceptible perturbations that easily misleading deep neural networks(DNNs). Recently, adversarial patch, with noise confined to a small and localized patch, has emerged for its easy feasibility in real-world scenarios. However, existing strategies failed to generate adversarial patches with strong generalization ability. In other words, the adversarial patches were input-specific and failed to attack images from all classes, especially unseen ones during training. To address the problem, this paper proposes a bias-based framework to generate class-agnostic universal adversarial patches with strong generalization ability, which exploits both the perceptual and semantic bias of models. Regarding the perceptual bias, since DNNs are strongly biased towards textures, we exploit the hard examples which convey strong model uncertainties and extract a textural patch prior from them by adopting the style similarities. The patch prior is more close to decision boundaries and would promote attacks. To further alleviate the heavy dependency on large amounts of data in training universal attacks, we further exploit the semantic bias. As the class-wise preference, prototypes are introduced and pursued by maximizing the multi-class margin to help universal training. Taking AutomaticCheck-out (ACO) as the typical scenario, extensive experiments including white-box and black-box settings in both digital-world(RPC, the largest ACO related dataset) and physical-world scenario(Taobao and JD, the world' s largest online shopping platforms) are conducted. Experimental results demonstrate that our proposed framework outperforms state-of-the-art adversarial patch attack methods.
BibTeX
@misc{liu2020patch,
  author = {Aishan Liu and Jiakai Wang and Xianglong Liu and Chongzhi Zhang and Bowen Cao and Hang Yu},
  title = {{Patch Attack for Automatic Check-out}},
  year = {2020},
  eprint = {2005.09257},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2005.09257},
}
Figure