Crafting Textual Adversarial Examples through Second-Order Enhanced Word Saliency

Pengwei Zhan, Yang Wu, Yunjian Zhang, Liming Wang, Chao Zheng, Jing YangIJCNN 2022 · OpenReview

Abstract

Textual adversarial examples crafted with well-designed perturbation can mislead state-of-the-art natural language models. Most previous works on word-level black-box attacks propose different text substituting strategies based on the word saliency determined by Leave One Out (LOO) methods, while the attack effectiveness is actually limited due to the model pathology. The word saliency determined by LOO methods can be severely affected by the model pathology, and unconscious bias is introduced. In this paper, we propose a word saliency method called Second-Order Enhanced Word Saliency (SOEWS), which considers the overfitting information obtained from the second-order model pathological behavior that helps to reduce the bias of LOO methods. Extensive experiments show that our method outperforms current black-box word saliency methods and can boost the effectiveness of previous attack frameworks. Performing adversarial training utilizing our method best improves model robustness, and human evaluation shows that the adversarial examples crafted by our method are almost imperceptible to humans. We also conduct case study to intuitively demonstrate the superiority of our method.
BibTeX
@inproceedings{zhan2022crafting,
  author = {Pengwei Zhan and Yang Wu and Yunjian Zhang and Liming Wang and Chao Zheng and Jing Yang},
  title = {{Crafting Textual Adversarial Examples through Second-Order Enhanced Word Saliency}},
  booktitle = {IJCNN},
  year = {2022},
  url = {https://openreview.net/forum?id=ROy6gHKetv},
}

Loading related content...

Figure