Introduction
Deep neural networks (DNNs) have demonstrated remarkable performance across various computer vision tasks but remain notoriously vulnerable to adversarial attacks. Most existing "black-box" attacks rely on the transferability of adversarial examples from a known surrogate model to an unknown target model. However, these methods often assume the attacker has access to the target model's training data distribution or label space—a scenario rarely encountered in real-world applications involving proprietary systems.
This paper introduces the Cross-Domain Transfer-Based Attack (CDTA), designed for the strict cross-domain setting. In this environment, the attacker possesses zero knowledge of the target model's architecture, parameters, training data, or label space. CDTA leverages a self-supervised feature extractor to generate highly transferable perturbations that disrupt semantic features, significantly outperforming current state-of-the-art methods.
Methodology
The CDTA framework operates in two distinct phases: Contrastive Spectral Training and Feature-Space Attack Generation.
Contrastive Spectral Training
Unlike traditional supervised surrogates, CDTA employs a feature extractor trained via self-supervised contrastive learning. To enhance domain-agnosticism, the authors introduce two key modifications to the standard SimSiam-style training:
- Weakened Augmentations: Texture-heavy augmentations (e.g., grayscale) are removed to prevent the model from over-relying on domain-specific textures, thereby balancing shape and texture biases.
- Spectral Pooling: An FFT-based spectral pooling layer is integrated to filter out high-frequency noise, forcing the network to prioritize high-level structural semantic information.
Feature-Space Attack Generation
Since the target label space is unknown, CDTA avoids attacking specific classification boundaries. Instead, it employs a custom loss function ($L_{efd+cos}$) to maximize disruption across both intermediate layers and the final output representation. The optimization process incorporates momentum, Gaussian kernel smoothing, and random transformations to ensure the generated perturbations do not overfit to the surrogate model.
Experimental Evaluation
The surrogate model was trained on ImageNet, while evaluation was conducted across four diverse target domains: Oxford 102 Flower, Food-101, BIRDS-400, and Comic Books. These datasets represent a wide spectrum of styles and subjects, providing a rigorous test for cross-domain transferability.
Key Results
CDTA was tested against 16 target architectures, including ResNet-34, DenseNet-161, Inception-v3, and VGG16bn. The method achieved an average Attack Success Rate (ASR) improvement of 11.45% over leading baselines like CDA and BIA. Notably, on the BIRDS-400 dataset, CDTA reached an ASR of 91.2% against a ResNet-34 target, compared to the 74.9% achieved by the best previous baseline.
Discussion and Insights
A critical finding of this research is that standard self-supervised learning is not inherently superior for cross-domain attacks. Vanilla contrastive learning often introduces biases that hinder transferability. By deliberately weakening texture-related augmentations, CDTA learns more generalized features. Furthermore, the results suggest that corrupting fundamental semantic features is a more robust strategy than attempting to navigate unknown decision boundaries in a black-box setting.
Conclusion and Future Work
CDTA establishes a new benchmark for evaluating model robustness in realistic, strict black-box scenarios. While highly effective, the authors observed that excessive optimization iterations can lead to overfitting on the surrogate model, particularly for architectures like Inception-v3. Future research should focus on developing defensive strategies capable of mitigating these feature-disruptive, cross-domain attacks.
Summary updated