Leveraging Domain Adaptation as a Defense Against Membership Inference Attacks

Hongwei Huang, Weiqi Luo, Guoqiang Zeng, Jian Weng, Yue Zhang, Anjia YangIEEE TDSC 2022 · OpenReview

TL;DR

This paper introduces DAMIA, a novel defense against membership inference attacks that leverages domain adaptation. By training a model on a mix of the sensitive target dataset and a related, but distinct, source dataset, DAMIA effectively obfuscates the original data, making it difficult for attackers to determine if a sample was part of the training set, while maintaining model usability.

What Problem Does This Paper Address?

Deep learning (DL) models are increasingly powerful and widely adopted, but this success brings significant security concerns. One such threat is the "membership inference attack," where an attacker tries to determine if a specific data point was used to train a DL model. This is a privacy violation, especially when models are trained on sensitive user data (e.g., medical records, location data). Existing defenses against these attacks often come with a high computational cost or degrade the model's performance and usability, creating a trade-off between security and utility. This paper aims to bridge this gap by proposing a defense that is both effective against membership inference attacks and maintains the model's practical usability.

Methods

The core of DAMIA lies in Domain Adaptation (DA). DA is a machine learning technique that allows a model trained on one dataset (the source domain) to perform well on a different, but related, dataset (the target domain). DAMIA leverages this by:

  1. Obfuscating the Sensitive Dataset: The sensitive dataset (the one used to train the victim model) is treated as the target domain.
  2. Introducing a Related Source Dataset: A separate, but similar, dataset is chosen as the source domain.
  3. Training with DA: A model is trained using DA techniques to learn a shared representation that captures common features from both the source and target domains. Crucially, the labels from the sensitive target dataset are removed during this DA training process.

The intuition is that by mixing the sensitive data with a related source dataset during training, the resulting model's decision-making process becomes "obfuscated." This makes it harder for an attacker to infer membership based on the model's predictions, as the model has learned from a blended, less identifiable data distribution. The paper explores various DA approaches, including discrepancy-based (like Deep Domain Confusion - DDC), adversarial-based (like ADDA), and reconstruction-based methods.

Datasets

The paper uses several standard datasets for evaluation:

  • MNIST: A dataset of handwritten digits (28x28 grayscale images).
  • SVHN (Street View House Numbers): A dataset of house numbers (32x32 color images).
  • Office-31: A dataset commonly used for domain adaptation, containing images of office objects from three domains: Amazon, DSLR, and Webcam.

These datasets were split into training and non-training (test) sets. The authors also explore the impact of source domain size and diversity by manipulating subsets of the Office-31 dataset.

Key Insights and Ideas

  • Domain Adaptation as a Privacy Shield: The core insight is that DA, typically used for improving model performance across domains, can be repurposed as a powerful defense mechanism against membership inference attacks by obfuscating the training data.
  • Balancing Security and Usability: DAMIA demonstrates that it's possible to significantly hinder membership inference attacks without a substantial drop in model accuracy or usability, addressing a key limitation of prior defenses.
  • Shared Representation is Key: The effectiveness of DAMIA relies on the shared representation learned by the DA model. This representation captures common features, allowing the model to still perform its task well, while the obfuscation prevents easy membership inference.
  • Source Domain Matters: The choice and characteristics of the source domain (size, diversity, similarity to the target) can influence DAMIA's performance, offering avenues for optimization.

Key Results

  • Effective Attack Deterrence: DAMIA consistently reduced the attacker's success rate to around 50%, which is equivalent to random guessing, across various datasets and model architectures (AlexNet, ResNet-50).
  • Negligible Usability Impact: The accuracy of models trained with DAMIA was comparable to or even slightly better than models trained without it, indicating minimal impact on usability. For instance, in one experiment, the membership inference accuracy dropped from 0.7732 to 0.5145 while test accuracy remained high.
  • DA Approach Comparison: Discrepancy-based and reconstruction-based DA approaches were found to be effective with DAMIA. Adversarial-based approaches showed less promising results, potentially due to convergence issues.
  • Factor Analysis:
    • Size: Increasing the size of the source dataset generally improved usability (test accuracy) without significantly harming effectiveness.
  • Diversity: Higher diversity in the source domain had a limited positive impact on usability and could even slightly impair effectiveness.
  • Similarity: Higher similarity between source and target domains led to better usability (test accuracy) and slightly improved effectiveness.

Limitations and Future Work

  • Manual Source Domain Selection: The current DAMIA approach requires manual selection of a suitable source domain. The authors suggest future work to explore mechanisms for automatically selecting or generating related datasets.
  • Adversarial DA Performance: The performance of adversarial-based DA methods with DAMIA was not as strong as other approaches, suggesting further research is needed in this area.
  • Generalizability: While tested on common datasets, further validation on more diverse and complex real-world scenarios would be beneficial.

Summary updated

Abstract

Deep Learning (DL) techniques allow ones to train models from a dataset to solve tasks. DL has attracted much interest given its fancy performance and potential market value, while security issues are amongst the most colossal concerns. However, the DL models may be prone to the membership inference attack, where an attacker determines whether a given sample is from the training dataset. Efforts have been made to hinder the attack but unfortunately, they may lead to a major overhead or impaired usability. In this article, we propose and implement DAMIA, leveraging Domain Adaptation (DA) as a defense aginist membership inference attacks. Our observation is that during the training process, DA obfuscates the dataset to be protected using another relate and similar dataset, and derives a model that underlyingly extracts the features from both datasets. Seeing that the model is obfuscated, membership inference fails, while the extracted features provide supports for usability. Extensive experiments have been conducted to validates our intuition. The model trained by DAMIA has a negligible footprint to the usability and introduces slight overhead compared with other defenses. Our experiment also excludes factors that may hinder the performance of DAMIA, and comparisons with other defenses, providing a potential guideline to vendors and researchers to benefit from our solution in a timely manner.
BibTeX
@article{huang2022leveraging,
  author = {Hongwei Huang and Weiqi Luo and Guoqiang Zeng and Jian Weng and Yue Zhang and Anjia Yang},
  title = {{Leveraging Domain Adaptation as a Defense Against Membership Inference Attacks}},
  journal = {IEEE Transactions on Dependable and Secure Computing},
  year = {2022},
  url = {https://openreview.net/forum?id=N7uvV9RZVI},
}
Figure