RobustEdge: Low Power Adversarial Detection for Cloud-Edge Systems

Abhishek Moitra, Abhiroop Bhattacharjee, Youngeun Kim, Priyadarshini Panda

TL;DR

RobustEdge is a low-power adversarial detection framework designed to sit at the "edge" of IoT systems, blocking malicious inputs before they are ever transmitted to the cloud. By employing a novel training method called Quantization-enabled Energy Separation (QES) and an "early exit" strategy, it reduces detection energy by 25x and improves overall system energy efficiency by over 166x compared to traditional cloud-centric defenses.

What Problem Does This Paper Address?

Deep Neural Networks (DNNs) are the backbone of modern cloud-edge systems, where a low-power device (like a smart camera) captures data and sends it to a powerful cloud server for processing. However, DNNs are notoriously vulnerable to adversarial attacks—subtle, intentional perturbations to input data that cause a model to misclassify.

Currently, most adversarial detection happens in the cloud, alongside the main classifier. This creates two major problems:

  1. Energy Wastage: The edge device spends significant energy transmitting malicious data that will eventually be discarded or cause an error.
  2. Computational Overhead: Existing detectors are often as complex as the classifiers themselves, making them too "heavy" to run on resource-constrained edge hardware.

The authors of RobustEdge aim to bridge this gap by creating a detector that is small enough to run at the edge, yet robust enough to filter out attacks before they hit the network.

Methods

The core of RobustEdge is a standalone, 3-layer convolutional detector trained using two primary innovations:

  • Quantization-enabled Energy Separation (QES): Instead of looking at final classification labels, RobustEdge looks at "energy signatures"—the magnitude of weighted summation outputs at each layer. The authors found that adversarial samples typically exhibit different energy distributions than natural ones. QES trains the detector to maximize this "energy gap" while simultaneously quantizing the model (to 12-bit or 16-bit) to ensure it runs efficiently on edge hardware.
  • Early Detection and Exit: To save even more power, the detector doesn't always need to run all three layers. It establishes "confidence boundaries" at each layer. If an input’s energy signature is clearly natural or clearly adversarial at Layer 1, the device makes an immediate decision and "exits," saving the computation cycles of Layers 2 and 3.
  • Classifier Agnosticism: Unlike many prior works, the RobustEdge detector is detached from the main classifier. This means you don't need to retrain your massive cloud model to gain edge-side security.

Datasets

The researchers evaluated RobustEdge using three standard computer vision benchmarks:

  • CIFAR10 & CIFAR100: Standard datasets for small-scale image recognition.
  • TinyImagenet: A more complex dataset with 200 classes, used to test the scalability of the detection method.

They tested the system against a wide battery of attacks, including gradient-based methods (like PGD and FGSM) and score-based "black-box" attacks (like Square Attack).

Key Insights and Ideas

  • Transmission is the Real Killer: In cloud-edge setups, the energy cost of moving data over Wi-Fi or LTE often dwarfs the cost of local computation. By "failing fast" at the edge, RobustEdge saves massive amounts of battery life.
  • The "Narrow" Advantage: Surprisingly, the authors found that a "narrower" detector (one with fewer channels) actually achieved higher detection accuracy than wider, more complex versions. This is a win-win for both security and efficiency.
  • Security Transferability: One of the most striking findings is that a detector trained on one dataset (e.g., TinyImagenet) can effectively detect attacks on a completely different dataset (e.g., CIFAR10). This suggests that adversarial "energy signatures" share universal characteristics that a small model can learn.

Key Results

  • High Accuracy: The 16-bit and 12-bit detectors achieved an Area Under the Curve (AUC) score > 0.9 across most gradient-based attacks.
  • Massive Energy Savings: Hardware evaluations on a 45nm CMOS digital accelerator showed that RobustEdge requires 25x lower energy for detection than prior state-of-the-art methods.
  • System Efficiency: By blocking 100% of adversarial transmissions, the total system energy efficiency improved by > 166x.
  • Early Exit Success: The "early exit" strategy alone reduced the detector's own energy consumption by 66% without sacrificing significant accuracy.

Limitations and Future Work

While RobustEdge excels at detecting gradient-based attacks, its performance on score-based attacks (which don't rely on model gradients) was lower, with AUC scores hovering around 0.7.

The authors also note that while the detector is "classifier-agnostic," it still requires a separate DNN to generate adversarial examples during its own training phase. Future work could explore even more "blind" training methods or investigate how this edge-blocking strategy holds up against "adaptive attackers" who specifically try to craft noise that mimics the energy signature of natural data.

Summary updated

Abstract

In practical cloud-edge scenarios, where a resource constrained edge performs data acquisition and a cloud system (having sufficient resources) performs inference tasks with a deep neural network (DNN), adversarial robustness is critical for reliability and ubiquitous deployment. Adversarial detection is a prime adversarial defense technique used in prior literature. However, in prior detection works, the detector is attached to the classifier model and both detector and classifier work in tandem to perform adversarial detection that requires a high computational overhead which is not available at the lowpower edge. Therefore, prior works can only perform adversarial detection at the cloud and not at the edge. This means that in case of adversarial attacks, the unfavourable adversarial samples must be communicated to the cloud which leads to energy wastage at the edge device. Therefore, a low-power edge-friendly adversarial detection method is required to improve the energy efficiency of the edge and robustness of the cloud-based classifier. To this end, RobustEdge proposes Quantization-enabled Energy Separation (QES) training with “early detection and exit” to perform edge-based low cost adversarial detection. The QEStrained detector implemented at the edge blocks adversarial data transmission to the classifier model, thereby improving adversarial robustness and energy-efficiency of the Cloud-Edge system. Through extensive experiments on CIFAR10, CIFAR100 and TinyImagenet, we find that 16-bit and 12-bit quantized detectors achieve a high AUC score $>$ 0.9 while improving the energy-efficiency of the cloud-edge system by $>166\times$ compared to prior cloud-based adversarial detection approaches.
BibTeX
@article{moitra2024robustedge,
  author = {Abhishek Moitra and Abhiroop Bhattacharjee and Youngeun Kim and Priyadarshini Panda},
  title = {{RobustEdge: Low Power Adversarial Detection for Cloud-Edge Systems}},
  journal = {IEEE Trans. Emerg. Top. Comput. Intell.},
  year = {2024},
  url = {https://openreview.net/forum?id=S9MuH4SDON},
}

Loading related content...

Figure