Learning Sample Reweighting for Adversarial Robustness

Chester Holtz, Tsui-Wei Weng, Gal MishneICLR 2022 · OpenReview

Abstract

There has been great interest in enhancing the robustness of neural network classifiers to defend against adversarial perturbations through adversarial training, while balancing the trade-off between robust accuracy and standard accuracy. We propose a novel adversarial training framework that learns to reweight the loss associated with individual training samples based on a notion of class-conditioned margin, with the goal of improving robust generalization. Inspired by MAML-based approaches, we formulate weighted adversarial training as a bilevel optimization problem where the upper-level task corresponds to learning a robust classifier, and the lower-level task corresponds to learning a parametric function that maps from a sample's \textit{multi-class margin} to an importance weight. Extensive experiments demonstrate that our approach improves both clean and robust accuracy compared to related techniques and state-of-the-art baselines.
BibTeX
@inproceedings{holtz2022learning,
  author = {Chester Holtz and Tsui-Wei Weng and Gal Mishne},
  title = {{Learning Sample Reweighting for Adversarial Robustness}},
  booktitle = {International Conference on Learning Representations},
  year = {2022},
  url = {https://openreview.net/forum?id=7zc05Ua_HOK},
}
Figure