Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learning

Byung-Kwan Lee, Junho Kim, Yong Man Ro

Abstract

Deep Neural Networks (DNNs) exhibit significant adversarial vulnerability, often varying drastically across different data classes and architectures. This paper presents Adversarial Double Machine Learning (ADML), a framework that reformulates adversarial robustness as a causal inference problem. By estimating the causal effect of perturbations on model predictions, ADML adaptively reweights training samples to prioritize the most vulnerable instances. Experimental results across multiple benchmarks and architectures (CNNs and Transformers) demonstrate that ADML effectively closes the robustness gap and outperforms state-of-the-art defense methods.

Introduction: The Robustness Gap

Despite the success of Adversarial Training (AT) as a primary defense against adversarial attacks, a persistent "robustness gap" remains. Standard models often show high robustness for certain classes while remaining highly susceptible in others. This non-uniformity suggests that current defenses, which typically treat all perturbations with equal weight, fail to address the underlying causal reasons why specific inputs are more fragile. This gap persists regardless of whether one utilizes deep CNNs or modern Vision Transformers.

Methodology: Adversarial Double Machine Learning (ADML)

ADML shifts the perspective from simple correlation to causal estimation. The framework identifies three key components: the original clean image (covariates, $x$), the adversarial perturbation (treatment, $t$), and the model's prediction (outcome, $y$). The goal is to estimate a causal parameter $\theta$ that measures the direct impact of the perturbation on the prediction.

The ADML framework treats adversarial perturbations as a causal treatment (t) affecting the outcome (y), allowing for a more robust training objective.

To estimate $\theta$ accurately without falling into statistical traps, ADML employs Double Machine Learning (DML) techniques, including sample-splitting and cross-fitting. A "balancing ratio" $\tau$ is then calculated based on the estimated causal parameter. This ratio acts as a dynamic weight during training: samples with high causal vulnerability (high $\theta$) receive greater emphasis in the loss function, forcing the model to learn more robust features for its weakest points. To maintain efficiency, the authors utilize a gradient approximation that combines attacked confidence and input gradients into a computationally feasible metric.

Key Results and Discussion

The effectiveness of ADML was evaluated on CIFAR-10, CIFAR-100, and ImageNet using various backbones, including VGG, ResNet, and Vision Transformers (ViT/DeiT). ADML consistently outperformed standard defense baselines like TRADES, MART, and AWP.

ADML significantly improves robustness for the most vulnerable samples (bottom 10%, 30%, and 50%) compared to standard Adversarial Training (AT) across various architectures.

As shown in the results, ADML significantly raises the "robustness floor." For instance, on CIFAR-10 with a VGG-16 backbone, robustness against Auto-Attack improved from 46.3% to 54.5%. Crucially, the improvement is most pronounced in the most vulnerable segments of the data, leading to more consistent performance across the entire dataset. The framework's success across both CNNs and Transformers indicates that the causal nature of adversarial vulnerability is a fundamental property shared across different neural architectures.

Conclusion

Adversarial Double Machine Learning provides a principled causal approach to enhancing model robustness. By identifying and focusing on the causal drivers of misclassification under attack, ADML offers a more nuanced and effective defense than traditional uniform adversarial training. While it introduces some computational overhead due to sample-splitting, the gains in robustness consistency make it a powerful tool for securing deep learning models. Future work may explore extending this causal framework to address other forms of distribution shift and natural corruptions.

Summary updated

Abstract

Adversarial examples derived from deliberately crafted perturbations on visual inputs can easily harm decision process of deep neural networks. To prevent potential threats, various adversarial training-based defense methods have grown rapidly and become a de facto standard approach for robustness. Despite recent competitive achievements, we observe that adversarial vulnerability varies across targets and certain vulnerabilities remain prevalent. Intriguingly, such peculiar phenomenon cannot be relieved even with deeper architectures and advanced defense methods. To address this issue, in this paper, we introduce a causal approach called Adversarial Double Machine Learning (ADML), which allows us to quantify the degree of adversarial vulnerability for network predictions and capture the effect of treatments on outcome of interests. ADML can directly estimate causal parameter of adversarial perturbations per se and mitigate negative effects that can potentially damage robustness, bridging a causal perspective into the adversarial vulnerability. Through extensive experiments on various CNN and Transformer architectures, we corroborate that ADML improves adversarial robustness with large margins and relieve the empirical observation.
BibTeX
@inproceedings{lee2023mitigating,
  author = {Byung-Kwan Lee and Junho Kim and Yong Man Ro},
  title = {{Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learning}},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year = {2023},
  doi = {10.1109/iccv51070.2023.00415},
}
Figure