Generative Extraction of Audio Classifiers for Speaker Identification

Tejumade Afonja, Lucas Bourtoule, Varun Chandrasekaran, Sageev Oore, Nicolas PapernotarXiv 2022 · DOI · arXiv

Abstract

Model extraction attacks, where an adversary queries a victim model to create a functional surrogate, pose a significant threat to intellectual property and security. While extensively studied in the visual and textual domains, audio classifiers—particularly those used for speaker identification—present unique challenges due to the task-specific nature of their deep features and the lack of universal proxy datasets. This paper introduces a generative extraction framework that utilizes WaveGAN to synthesize diverse audio queries. By iteratively sampling synthetic speech, the researchers achieved over 84% accuracy in mimicking a victim model trained on raw waveforms, demonstrating a critical vulnerability in voice-based biometric systems.

Introduction

Model extraction is a form of adversarial machine learning where an attacker attempts to "steal" a target model's functionality by querying its API. By observing the outputs (labels or probabilities) for a set of inputs, the attacker trains a surrogate model to replicate the victim's decision boundaries. While this threat is well-documented for image and text processing, waveform-based audio classifiers have remained relatively unexplored. This research addresses this gap, revealing that the unique structure of audio data requires a novel approach to extraction: Generative Extraction.

The Transferability Gap in Audio

A primary hurdle in extracting audio models is the "transferability gap." In computer vision, early layers typically learn generic features, such as edges and textures, which transfer effectively across different datasets. In contrast, audio models—specifically those designed for speaker identification—develop highly task-dependent features in their deeper layers. These layers focus on the specific frequency contours and vocal characteristics of individual speakers in the training set.

Extraction test accuracy vs. number of transferred layers, illustrating the performance drop when using out-of-distribution proxy data for deeper layers.

As shown in the figure above, while the first layer is relatively easy to extract using proxy data, the accuracy of the surrogate model plateaus when attempting to replicate deeper layers using out-of-distribution datasets like VoxCeleb. This lack of a "universal" audio feature set makes traditional extraction techniques, which rely on static proxy datasets, significantly less effective.

Generative Extraction Framework

To overcome the transferability gap, the authors propose a framework that uses a generative model to "expand" the attack surface. Instead of relying on a fixed proxy dataset, the attacker uses a WaveGAN trained on proxy data (VoxCeleb) to synthesize millions of diverse audio queries.

The process involves several key steps:

  1. Generative Synthesis: WaveGAN produces synthetic audio samples that mimic the general properties of human speech without being tied to specific training samples.
  2. Iterative Sampling and Thresholding: To ensure the surrogate model learns the victim's entire decision space, the researchers implemented dynamic thresholding. This prevents the surrogate from becoming biased toward "easy" speakers by limiting the number of queries for any single predicted label.
  3. Oracle Labeling: These synthetic queries are sent to the victim model (the "Oracle"), which provides either hard labels or soft probability vectors. These labels are then used to train the surrogate model.

Key Insights

The success of the attack hinges on coverage rather than just query volume. An effective attack must coax a wide variety of unique labels from the victim model. Generative models are uniquely suited for this because they can be modified to produce a more diverse set of queries than a static dataset, effectively "filling in the gaps" of the victim's decision boundaries.

A first-layer filter visualization showing the capture of fundamental frequency information.

Visualizing the internal filters of the victim model confirms that while early layers capture fundamental frequency information (as seen above), deeper layers are tuned to the specific nuances of the speaker's voice, necessitating the high-diversity queries provided by the GAN.

Results and Analysis

The generative approach significantly outperformed baseline methods. Direct extraction using the VoxCeleb dataset against a LibriSpeech-trained victim model yielded a test accuracy of only 64.80%. However, by employing WaveGAN for query synthesis and applying iterative sampling, the attacker achieved a test accuracy of 84.90% with a budget of 3 million queries.

The research also found that the attack is most effective when the victim model returns "soft labels" (full probability vectors), as these provide richer information about the model's internal logic and decision boundaries compared to simple "hard" class labels.

Conclusion

This work demonstrates the first successful model extraction attack on waveform-based audio classifiers. By leveraging generative models to overcome the transferability gap, attackers can effectively steal speaker identification models even without access to the original training data. These findings highlight a significant security vulnerability in voice-based biometric systems and underscore the need for robust defenses against generative model extraction.

Summary updated

Abstract

It is perhaps no longer surprising that machine learning models, especially deep neural networks, are particularly vulnerable to attacks. One such vulnerability that has been well studied is model extraction: a phenomenon in which the attacker attempts to steal a victim's model by training a surrogate model to mimic the decision boundaries of the victim model. Previous works have demonstrated the effectiveness of such an attack and its devastating consequences, but much of this work has been done primarily for image and text processing tasks. Our work is the first attempt to perform model extraction on {\em audio classification models}. We are motivated by an attacker whose goal is to mimic the behavior of the victim's model trained to identify a speaker. This is particularly problematic in security-sensitive domains such as biometric authentication. We find that prior model extraction techniques, where the attacker \textit{naively} uses a proxy dataset to attack a potential victim's model, fail. We therefore propose the use of a generative model to create a sufficiently large and diverse pool of synthetic attack queries. We find that our approach is able to extract a victim's model trained on \texttt{LibriSpeech} using queries synthesized with a proxy dataset based off of \texttt{VoxCeleb}; we achieve a test accuracy of 84.41\% with a budget of 3 million queries.
BibTeX
@misc{afonja2022generative,
  author = {Tejumade Afonja and Lucas Bourtoule and Varun Chandrasekaran and Sageev Oore and Nicolas Papernot},
  title = {{Generative Extraction of Audio Classifiers for Speaker Identification}},
  year = {2022},
  eprint = {2207.12816},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2207.12816},
}
Figure