Replay Attack Detection with Complementary High-Resolution Information Using End-to-End DNN for the ASVspoof 2019 Challenge

Jee-weon Jung, Hye-jin Shim, Hee-Soo Heo, Ha-Jin YuInterspeech 2019 · DOI

Abstract

This paper introduces an end-to-end deep learning framework for replay attack detection, moving away from traditional hand-crafted acoustic features. By leveraging high-resolution spectrograms and integrating complementary information from magnitude, phase, and power spectral density (PSD), the researchers developed a CNN-GRU hybrid model. This approach achieved significant performance gains in the ASVspoof 2019 Physical Access challenge, demonstrating that high-resolution, unprocessed spectral data allows deep neural networks to learn more discriminative features for distinguishing bona-fide speech from high-quality recordings.

Introduction: The Challenge of Replay Attacks

Automatic Speaker Verification (ASV) systems are increasingly vulnerable to "replay attacks," where an attacker records a target's voice and plays it back to gain unauthorized access. Historically, detection methods relied on hand-crafted features like Constant Q Cepstral Coefficients (CQCC), assuming that playback devices introduce detectable high-frequency distortions. However, as hardware quality improves, these distortions become subtler. Conventional features often smooth over these fine details, making it difficult to differentiate between genuine and spoofed speech. This research addresses the problem by providing models with high-resolution, raw spectral data, allowing them to learn these subtle discriminative artifacts autonomously.

Methods: High-Resolution End-to-End Architecture

The proposed system utilizes a CNN-GRU hybrid architecture designed to process high-resolution spectral inputs.

  • High-Resolution Input: The model uses a 2048-bin Fast Fourier Transform (FFT) instead of the standard 512-bin version. This higher resolution preserves fine spectral details where replay artifacts are most likely to reside.
  • Complementary Information: The system incorporates three distinct views of the audio signal: magnitude spectrograms, phase spectrograms, and Power Spectral Density (PSD). While phase information is often discarded in audio tasks, it provides unique cues that complement magnitude data.
  • Architecture: Residual blocks (ResNet-style) extract frame-level features, which are then aggregated over the entire utterance by a Gated Recurrent Unit (GRU) to produce a final classification score.
Visual comparison of magnitude, phase, and PSD spectrograms for bona-fide and spoofed speech.

Datasets and Evaluation

The study was evaluated using the ASVspoof 2019 Physical Access (PA) dataset, which contains over 220,000 utterances across training, development, and evaluation sets. The dataset simulates 27 different acoustic configurations, varying room sizes, reverberation levels, and distances. Crucially, the evaluation set includes replay configurations not seen during training, testing the model's ability to generalize to unseen devices and environments.

Key Insights: Resolution and Complementarity

  • Resolution is King: Increasing the FFT resolution from 512 to 2048 bins reduced the Equal Error Rate (EER) from 7.83% to 3.07% for a single magnitude-based system. This confirms that critical replay artifacts are "hidden in the details."
  • Phase and PSD Utility: Combining phase and magnitude information consistently outperformed magnitude alone. Similarly, PSD offers a different "lens" on power distribution that helps catch attacks missed by magnitude-only systems.
  • End-to-End Superiority: The data-driven feature extraction of the DNN significantly outperformed the challenge's CQCC-GMM baseline.

Key Results

The researchers' primary system, an ensemble of multiple specialized models, achieved top-tier performance on the ASVspoof 2019 evaluation set.

Performance comparison of different feature sets and ensemble methods.

As shown in the table above, the "Spec-magnitude" system alone achieves an EER of 1.76%, a massive improvement over the 9.87% baseline. The final "Primary" ensemble reached an EER of 2.45% on the evaluation set, reducing the error rate by nearly 80% compared to the challenge's 11.04% baseline.

Limitations and Future Work

Despite its success, the primary system's complexity—an ensemble of nine models—makes it computationally expensive for real-time use on edge devices. Additionally, performance is highly sensitive to windowing strategies (length and shift). Future work will focus on optimizing these parameters and ensuring continued robustness as playback technology reaches "near-perfect" fidelity, potentially requiring even higher spectral resolutions.

Summary updated

BibTeX
@inproceedings{jung2019replay,
  author = {Jee-weon Jung and Hye-jin Shim and Hee-Soo Heo and Ha-Jin Yu},
  title = {{Replay Attack Detection with Complementary High-Resolution Information Using End-to-End DNN for the ASVspoof 2019 Challenge}},
  booktitle = {Interspeech},
  year = {2019},
  doi = {10.21437/interspeech.2019-1991},
}
Figure