Adversarial Amendment is the Only Force Capable of Transforming an Enemy into a Friend

Chong Yu, Tao Chen, Zhongxue Gan

Introduction

In the field of artificial intelligence security, a persistent challenge known as the "accuracy tax" has long plagued researchers. While adversarial training can make neural networks robust against malicious perturbations—tiny, often imperceptible changes designed to fool a model—this robustness typically comes at the cost of performance on standard, "benign" images. This paper introduces Adversarial Amendment (AdvAmd), a novel framework that reframes adversarial attacks not just as threats, but as tools to enhance a model's accuracy on clean data.

The Problem: Distribution Mismatch and the Accuracy Tax

The degradation in benign accuracy during adversarial training stems from two primary issues:

  1. Distribution Mismatch: Benign and adversarial samples possess distinct statistical properties. Forcing a single set of model parameters to accommodate both distributions simultaneously often results in a "fuzzy" or suboptimal decision boundary.
  2. Mutual Learning Mechanism: Conventional defense strategies often treat benign and adversarial samples with an identical learning ratio. This lack of differentiation leads to a smoother but less precise judgment surface, compromising the model's ability to make fine-grained classifications on clean data.
Conceptual comparison of vanilla detection, adversarial attack, and adversarial defense distributions.

Methodology: The Adversarial Amendment (AdvAmd) Framework

AdvAmd shifts the paradigm from simple defense to "amendment" by leveraging three core components designed to bridge the gap between benign and adversarial domains:

  • Mediate Samples: To facilitate a smoother transition between clean and fully attacked distributions, the authors generate "mediate" samples. These are images that have undergone only partial perturbation, acting as an interpolative bridge for the model's learning process.
  • Auxiliary Batch Normalization (Auxiliary BN): To address the statistical conflict between data types, AdvAmd employs a dual-BN architecture. Standard BN layers process benign and mediate samples, while a dedicated set of auxiliary BN layers handles adversarial samples. This disentanglement prevents noisy adversarial statistics from corrupting the model's representation of clean data.
  • AdvAmd Loss with Vulnerability Coefficients: Recognizing that different object classes vary in their susceptibility to attack, the authors introduce a class-specific "vulnerability coefficient" ($A$). This coefficient dynamically adjusts the learning ratio, focusing the model's optimization efforts on the most vulnerable categories.

Experimental Evaluation

The effectiveness of AdvAmd was validated across several large-scale, industry-standard benchmarks, including ImageNet for classification (using ResNet-50 and DeiT) and COCO for object detection and semantic segmentation (using Faster R-CNN, YOLO-V5, and Mask R-CNN).

Key Results and Insights

The primary breakthrough of AdvAmd is its ability to turn the "accuracy tax" into an "accuracy bonus."

  • Benign Accuracy Boost: Unlike traditional defense methods that typically reduce clean-data performance, AdvAmd consistently achieved a 1.2% to 2.5% increase in Top-1 accuracy or mean Average Precision (mAP) on benign datasets.
  • Maintained Robustness: Despite the focus on clean-data improvement, AdvAmd remains a potent defense. It significantly outperforms vanilla models when subjected to standard attacks like FGSM, PGD, and DeepFool.
  • Cross-Architecture Generalization: The framework's success across diverse architectures—from traditional CNNs to modern Transformers—demonstrates its broad applicability.
Delta Top-1 Accuracy on Benign ImageNet Dataset, showing AdvAmd's unique ability to improve clean data performance compared to other defense methods.

The core philosophy of AdvAmd is that adversarial attacks reveal a model's inherent weaknesses. By surgically "amending" the model at these specific points of vulnerability, researchers can create models that are more precise than their original, undefended counterparts.

Limitations and Future Directions

While promising, AdvAmd introduces certain trade-offs. The iterative generation of adversarial and mediate samples increases the computational cost of training. Additionally, the current implementation relies on "white-box" access to model gradients, and its performance in "black-box" settings requires further investigation. Future research may explore applying the "amendment" philosophy to other forms of data corruption, such as environmental noise in autonomous driving systems.

Summary updated

Abstract

Adversarial attack is commonly regarded as a huge threat to neural networks because of misleading behavior. This paper presents an opposite perspective: adversarial attacks can be harnessed to improve neural models if amended correctly. Unlike traditional adversarial defense or adversarial training schemes that aim to improve the adversarial robustness, the proposed adversarial amendment (AdvAmd) method aims to improve the original accuracy level of neural models on benign samples. We thoroughly analyze the distribution mismatch between the benign and adversarial samples. This distribution mismatch and the mutual learning mechanism with the same learning ratio applied in prior art defense strategies is the main cause leading the accuracy degradation for benign samples. The proposed AdvAmd is demonstrated to steadily heal the accuracy degradation and even leads to a certain accuracy boost of common neural models on benign classification, object detection, and segmentation tasks. The efficacy of the AdvAmd is contributed by three key components: mediate samples (to reduce the influence of distribution mismatch with a fine-grained amendment), auxiliary batch norm (to solve the mutual learning mechanism and the smoother judgment surface), and AdvAmd loss (to adjust the learning ratios according to different attack vulnerabilities) through quantitative and ablation experiments.
BibTeX
@inproceedings{yu2023adversarial,
  author = {Chong Yu and Tao Chen and Zhongxue Gan},
  title = {{Adversarial Amendment is the Only Force Capable of Transforming an Enemy into a Friend}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2023},
  doi = {10.24963/ijcai.2023/503},
}
Figure