Privacy aware offloading of deep neural networks

Sam Leroux, Tim Verbelen, Pieter Simoens, Bart Dhoedt

Introduction

Offloading computationally intensive Deep Neural Network (DNN) tasks to cloud servers is a common practice for resource-constrained edge devices. However, this process often necessitates the transmission of raw, sensitive data to third-party providers, posing significant privacy risks. Traditional encryption methods protect data in transit but require decryption at the server side for processing. This paper proposes a lightweight "obfuscator" network that transforms images into human-unintelligible noise while preserving the essential features required for high-accuracy classification by standard, pretrained AI models.

Methodology

The proposed system employs a three-part architecture designed for collaborative training but independent deployment.

System architecture for privacy-aware offloading featuring the Obfuscator, Classifier, and Deobfuscator components.
  1. The Obfuscator (Local): A compact autoencoder deployed on the edge device. It scrambles clear images into an obfuscated format.
  2. The Classifier (Cloud): A standard, pretrained network (e.g., VGG19, ResNet) that remains unmodified. This allows users to utilize existing high-performance cloud APIs without retraining.
  3. The Deobfuscator (Training only): An adversarial network used during training to attempt reconstruction of the original image from the obfuscated output.

The Obfuscator is trained using a multi-objective loss function. It aims to minimize classification loss ($L_c$) to ensure the cloud model maintains accuracy, while simultaneously maximizing reconstruction loss ($L_r$) to prevent the Deobfuscator from recovering identifiable details. This adversarial setup forces the Obfuscator to strip "human-centric" features while retaining "machine-centric" mathematical features. Evaluation was conducted using the CIFAR-10 dataset.

Key Results

The experimental results demonstrate that the obfuscation process maintains high classification performance with minimal computational cost.

Accuracy and computational overhead across different architectures, comparing plain vs. obfuscated inputs.

As shown in the table above, the accuracy drop across various architectures is consistently low, typically around 5%. For instance, ResNet50 accuracy decreased from 95.1% on plain images to 90.2% on obfuscated ones. Crucially, the Obfuscator is extremely efficient, adding only 1.7% to 6.7% in FLOPs overhead relative to the primary classification network, making it highly suitable for IoT deployment. Qualitative analysis confirms that reconstructed images appear as unintelligible blobs, effectively protecting privacy.

Discussion and Insights

The study reveals that the visual features required for human recognition (such as fine textures and sharp edges) differ significantly from those utilized by DNNs. The Obfuscator effectively learns to "speak the language" of the DNN's internal layers. Interestingly, features preserved by an obfuscator trained for one architecture (e.g., ResNet50) often transfer to others (e.g., VGG19), suggesting the existence of "universal" visual features across deep learning models.

Despite these promising results, some limitations remain. Training currently requires a "white-box" setting where model weights are accessible for backpropagation, complicating use with proprietary "black-box" APIs. Additionally, while the system performs well on CIFAR-10's 32x32 images, further research is needed to evaluate scaling to high-resolution data and improving the "plug-and-play" transferability between disparate architectures.

Summary updated

Abstract

Deep neural networks require large amounts of resources which makes them hard to use on resource constrained devices such as Internet-of-things devices. Offloading the computations to the cloud can circumvent these constraints but introduces a privacy risk since the operator of the cloud is not necessarily trustworthy. We propose a technique that obfuscates the data before sending it to the remote computation node. The obfuscated data is unintelligible for a human eavesdropper but can still be classified with a high accuracy by a neural network trained on unobfuscated images.
BibTeX
@inproceedings{leroux2018privacy,
  author = {Sam Leroux and Tim Verbelen and Pieter Simoens and Bart Dhoedt},
  title = {{Privacy aware offloading of deep neural networks}},
  booktitle = {Ghent},
  year = {2018},
}
Figure