MEAOD: Model Extraction Attack against Object Detectors

Zeyu Li, Chenghui Shi, Yuwen Pu, Xuhong Zhang, Yu Li, Jinbao Li, Shouling JiarXiv 2023 · DOI · arXiv

Introduction

Model Extraction Attacks (MEAs) represent a significant security threat to Machine Learning as a Service (MLaaS) platforms. In these attacks, an adversary queries a proprietary victim model with unlabeled data to train a "substitute" model that mimics the original's functionality. While MEAs are well-documented for image classification, object detection presents unique challenges due to its dual-task nature: simultaneous classification and precise localization (bounding box regression).

MEAOD (Model Extraction Attack against Object Detectors) is a novel framework designed to overcome these hurdles. It achieves high fidelity to victim models by combining uncertainty-aware active learning with automated Internet data mining to address data imbalance and noisy API outputs.

The MEAOD Framework

The MEAOD framework addresses the inefficiencies of standard extraction methods through a three-pronged strategy designed for the complexities of object detection.

Overview of the MEAOD framework, illustrating dataset construction, substitute training, and the MLaaS interaction.

1. Two-Stage Query Dataset Construction

To maximize the information gained from each query, MEAOD uses a two-stage approach:

  • Active Learning Stage: Instead of random sampling, the attacker uses a small substitute model to identify "uncertain" images. Uncertainty is calculated based on both classification confidence and localization stability (e.g., the overlap of predicted boxes).
  • Internet Enhancement Stage: To mitigate the "rare category" problem—where the attacker's local data lacks specific classes present in the victim model—the system automatically queries search engines (like Google or Bing) for underrepresented categories. A fitness-based filtering method then selects the most informative images for the query set.

2. Scale-Consistency Annotation Updating

Victim models often return noisy detections due to internal post-processing like Non-Maximum Suppression (NMS). MEAOD filters these by querying the victim model with the same image at different scales. If the victim detects an object consistently across various sizes (scale invariance), the label is deemed high-quality and added to the training set.

3. Substitute Training

The refined query dataset, labeled by the victim model, is used to train a local substitute model (such as a YOLO variant) using standard detection loss functions.

Experimental Setup

The researchers evaluated MEAOD using four major computer vision benchmarks:

  • General Detection: COCO and VOC datasets were used to simulate generic object detection tasks.
  • Autonomous Driving: nuImages and BDD100k datasets simulated specialized, real-world deployment scenarios.

In a typical setup, the training sets of VOC or BDD100k served as the attacker's unlabeled data, while COCO or nuImages represented the victim's domain.

Key Results and Performance

MEAOD demonstrates remarkable efficiency and fidelity, even in black-box scenarios where the victim's architecture is unknown.

Performance of the substitute model (mAP@50 and mAP@50:95) relative to the query budget.
  • High Fidelity: In gray-box scenarios (known architecture), MEAOD achieved over 70% of the victim's mean Average Precision (mAP) with only 10,000 queries.
  • Black-Box Robustness: When using a YOLOv5 model to steal from a Fast R-CNN victim, the attack remained highly effective, often reaching over 80% relative performance.
  • Cost Efficiency: Stealing a model via MEAOD proved significantly more economical than building one from scratch, requiring far less training time and data.

Insights and Limitations

Key Insights

  • Multi-Task Penalty: Classification-only extraction methods fail in detection because they ignore geometric stability and "objectness."
  • Internet as an Equalizer: Search engines allow attackers to bridge distribution gaps by specifically hunting for rare classes, making the attack viable even with poor initial local datasets.
  • Consistency as Truth: Scale invariance is a reliable proxy for label quality in black-box settings.

Limitations and Future Work

MEAOD currently requires a small "seed" of real-world samples to initialize active learning and faces potential overfitting risks during iterative training. Future research will explore reducing data requirements further and investigating defense mechanisms, such as perturbing confidence scores, that do not degrade performance for legitimate users.

Summary updated

Abstract

The widespread use of deep learning technology across various industries has made deep neural network models highly valuable and, as a result, attractive targets for potential attackers. Model extraction attacks, particularly query-based model extraction attacks, allow attackers to replicate a substitute model with comparable functionality to the victim model and present a significant threat to the confidentiality and security of MLaaS platforms. While many studies have explored threats of model extraction attacks against classification models in recent years, object detection models, which are more frequently used in real-world scenarios, have received less attention. In this paper, we investigate the challenges and feasibility of query-based model extraction attacks against object detection models and propose an effective attack method called MEAOD. It selects samples from the attacker-possessed dataset to construct an efficient query dataset using active learning and enhances the categories with insufficient objects. We additionally improve the extraction effectiveness by updating the annotations of the query dataset. According to our gray-box and black-box scenarios experiments, we achieve an extraction performance of over 70% under the given condition of a 10k query budget.
BibTeX
@misc{li2023meaod,
  author = {Zeyu Li and Chenghui Shi and Yuwen Pu and Xuhong Zhang and Yu Li and Jinbao Li and Shouling Ji},
  title = {{MEAOD: Model Extraction Attack against Object Detectors}},
  year = {2023},
  eprint = {2312.14677},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2312.14677},
}
Figure