Corrupting Data to Remove Deceptive Perturbation: Using Preprocessing Method to Improve System Robustness

Hieu Le, Hans Walker, Dung N. Tran, Peter Chin

Abstract

Deep neural networks are highly effective for classification but remain vulnerable to subtle, adversarial noises. This paper proposes a novel defense mechanism that applies a recovery process to inputs before they reach a naturally trained classifier. By intentionally corrupting images with significant noise and then reconstructing them using SARGAN—a Generative Adversarial Network variant originally for radar signal denoising—we can effectively strip away adversarial effects. Our findings demonstrate that this preprocessing pipeline significantly restores the accuracy of standard classifiers under attack.

Introduction: The Vulnerability of Deep Learning

Despite achieving superhuman performance in computer vision, deep neural networks (DNNs) are notoriously fragile. Adversarial attacks—imperceptible, mathematically optimized perturbations—can force a model to misclassify an image with high confidence. While adversarial training is the standard defense, it is computationally expensive and often reduces a model's performance on clean data. This research explores an alternative: can we "wash" the data before it reaches the model?

Methods: The "Wash and Rinse" Defense

The authors propose a modular preprocessing pipeline that decouples defense from classification. This approach involves three primary stages:

  1. Intentional Corruption: Upon receiving an input, the system adds random white Gaussian noise. This step is counter-intuitive but crucial; it aims to "swamp" the precise adversarial perturbations with stochastic noise.
  2. Denoising with SARGAN: The corrupted image is processed by SARGAN (Synthetic Aperture Radar Generative Adversarial Network). Trained purely on standard noise patterns (not adversarial ones), SARGAN reconstructs the clean image.
  3. Sequential Filtering: To enhance the cleaning effect, the output can be passed through multiple SARGAN stages (up to four) sequentially.
The recovery process on an MNIST digit, showing the original image, the intentionally corrupted version, and the final recovered output.

Experimental Results

The defense was tested against Projected Gradient Descent (PGD) attacks on several benchmarks, including MNIST, Fashion-MNIST, and CIFAR-10/100. Without defense, PGD attacks reduced classifier accuracy to near 0%.

Applying a 4-stage SARGAN filter led to dramatic recoveries:

  • MNIST: Accuracy rose from 0.66% to 89.08%.
  • Fashion-MNIST: Accuracy rose from 0% to 71.76%.
  • CIFAR-10: Accuracy rose from 0.99% to 51.58%.
Demonstration of the preprocessing pipeline on a Fashion-MNIST item (a shoe), illustrating successful recovery from corruption.

Crucially, this preprocessing had minimal impact on clean data performance, typically maintaining accuracy within 1% of the baseline. This suggests that the "wash and rinse" cycle effectively targets malicious perturbations while preserving essential features.

Key Insights

  • Fighting Noise with Noise: Stochastic Gaussian noise dilutes the specific, brittle structure of adversarial attacks.
  • Attack Agnosticism: Because the denoiser is not trained on specific attacks, it remains a generic defense against various $L_p$ norm perturbations.
  • Modularity: This method allows for the use of high-performance, naturally trained models without the overhead of adversarial retraining.

Conclusion

While the absolute performance of SARGAN-based recovery does not yet match the state-of-the-art in adversarial training, it offers a promising, modular alternative. Future work will focus on optimizing SARGAN specifically for adversarial filtering and testing against a wider array of attack vectors.

Summary updated

Abstract

Although deep neural networks have achieved great performance on classification tasks, recent studies showed that well trained networks can be fooled by adding subtle noises. This paper introduces a new approach to improve neural network robustness by applying the recovery process on top of the naturally trained classifier. In this approach, images will be intentionally corrupted by some significant operator and then be recovered before passing through the classifiers. SARGAN -- an extension on Generative Adversarial Networks (GAN) is capable of denoising radar signals. This paper will show that SARGAN can also recover corrupted images by removing the adversarial effects. Our results show that this approach does improve the performance of naturally trained networks.
BibTeX
@inproceedings{le2021corrupting,
  author = {Hieu Le and Hans Walker and Dung N. Tran and Peter Chin},
  title = {{Corrupting Data to Remove Deceptive Perturbation: Using Preprocessing Method to Improve System Robustness}},
  booktitle = {CSCI},
  year = {2021},
  doi = {10.1109/csci54926.2021.00308},
}
Figure