FADEL: Uncertainty-aware Fake Audio Detection with Evidential Deep Learning

Ju Yeon Kang, Ji Won Yoon, Semin Kim, Min Hyun Han, Nam Soo Kim

Introduction

Automatic Speaker Verification (ASV) systems are increasingly vulnerable to sophisticated spoofing attacks, including speech synthesis and voice conversion. Traditional countermeasure (CM) models typically rely on softmax-based classification. However, softmax is inherently "greedy," often producing overconfident predictions even for out-of-distribution (OOD) samples. This overconfidence is a significant security risk, as a model may confidently misclassify a novel, unseen attack as "bonafide."

To address this, we present FADEL (Fake Audio Detection with Evidential Learning), which incorporates Evidential Deep Learning (EDL) to quantify predictive uncertainty. By moving beyond point estimates to a distribution over class probabilities, FADEL allows models to "know what they don't know."

Methodology: Evidential Deep Learning

The core of FADEL is the replacement of the standard softmax layer with an evidential framework based on Subjective Logic. The authors integrated FADEL into two state-of-the-art backbone models: Res-TSSDNet and AASIST.

The FADEL architecture: Evidence is generated via a Softplus layer and used to parameterize a Dirichlet distribution, enabling uncertainty quantification.

As shown in Figure 1, the process involves:

  1. Evidence Generation: The final layer of the backbone model uses a Softplus activation to produce non-negative evidence values ($e_k$) for each class.
  2. Dirichlet Distribution: These evidence values parameterize a Dirichlet distribution, $D(\mathbf{p}|\boldsymbol{\alpha})$, where $\alpha_k = e_k + 1$. This distribution represents the model's belief over possible class probability assignments.
  3. Uncertainty Quantification: Total uncertainty ($u$) is inversely proportional to the total evidence collected. High evidence leads to low uncertainty and vice versa.
  4. Learning Objective: The model is trained using an evidential loss function ($L_{EL}$) that balances classification accuracy with the minimization of evidence for incorrect classes, effectively regularizing the model against overconfidence.

Experimental Setup

FADEL was evaluated using the ASVspoof2019 and ASVspoof2021 Logical Access (LA) datasets. The 2019 evaluation set contains 13 unseen attack types, serving as a test for OOD robustness. The 2021 dataset provides a cross-dataset challenge, testing generalization across different recording environments and newer attack methodologies.

Results and Discussion

FADEL consistently improves performance over standard softmax baselines. When integrated with the AASIST backbone, FADEL reduced the Equal Error Rate (EER) by 18% and the minimum tandem Detection Cost Function (min t-DCF) by 27% on the ASVspoof2019 LA dataset. Ablation studies confirmed that the choice of activation function is critical, with Softplus providing the optimal balance for minimizing the min t-DCF.

Generalization and Uncertainty

A key advantage of FADEL is its superior generalization. In cross-dataset tests (trained on 2019, tested on 2021), AASIST-FADEL achieved an EER of 5.60%, outperforming specialized generalization techniques like ASAM (6.10%).

Correlation between Equal Error Rate (EER) and Average Uncertainty across different spoofing algorithms.

Crucially, the model's internal uncertainty serves as a reliable proxy for its error rate. As illustrated in Figure 3, there is a strong positive correlation between the average uncertainty and the EER across various spoofing algorithms (A07-A19). This validates that the evidential framework provides a physically meaningful metric of "untrustworthiness" for specific inputs.

Conclusion

FADEL addresses the overconfidence problem in fake audio detection by leveraging Evidential Deep Learning. By quantifying uncertainty, the system becomes more robust to unseen attacks and provides a transparent metric for its own reliability. Future work will explore the application of this framework to multi-modal biometric security and other forms of deepfake detection.

Summary updated

Abstract

Recently, fake audio detection has gained significant attention, as advancements in speech synthesis and voice conversion have increased the vulnerability of automatic speaker verification (ASV) systems to spoofing attacks. A key challenge in this task is generalizing models to detect unseen, out-of-distribution (OOD) attacks. Although existing approaches have shown promising results, they inherently suffer from overconfidence issues due to the usage of softmax for classification, which can produce unreliable predictions when encountering unpredictable spoofing attempts. To deal with this limitation, we propose a novel framework called fake audio detection with evidential learning (FADEL). By modeling class probabilities with a Dirichlet distribution, FADEL incorporates model uncertainty into its predictions, thereby leading to more robust performance in OOD scenarios. Experimental results on the ASVspoof2019 Logical Access (LA) and ASVspoof2021 LA datasets indicate that the proposed method significantly improves the performance of baseline models. Furthermore, we demonstrate the validity of uncertainty estimation by analyzing a strong correlation between average uncertainty and equal error rate (EER) across different spoofing algorithms.
BibTeX
@inproceedings{kang2025fadel,
  author = {Ju Yeon Kang and Ji Won Yoon and Semin Kim and Min Hyun Han and Nam Soo Kim},
  title = {{FADEL: Uncertainty-aware Fake Audio Detection with Evidential Deep Learning}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2025},
  doi = {10.1109/icassp49660.2025.10888053},
}
Figure