Text-independent speaker verification using rank threshold in large number of speaker models

Haruka Okamoto, Satoru Tsuge, Amira Abdelwahab, Masafumi Nishida, Yasuo Horiuchi, Shingo KuroiwaInterspeech 2009

TL;DR

This paper introduces a novel speaker verification method that uses the rank of a claimed speaker's model within a large set of models, rather than a normalized score, to determine identity. This "Speaker Ranking Selection" (SRS) method achieves better accuracy than traditional T-norm, and a data-driven approach significantly speeds up computation by selecting a subset of relevant models.

What Problem Does This Paper Address?

Speaker verification systems aim to confirm a person's identity based on their voice. A major challenge is the variability in speech signals due to factors like background noise, microphone differences, and natural speech variations. Traditional systems often use score normalization techniques (like T-norm) to compensate for this variability by comparing a target speaker's score against scores from a set of "background" or "impostor" models. However, these normalization methods can be computationally expensive, especially when dealing with a very large number of potential speakers. This paper addresses the need for a more accurate and computationally efficient speaker verification method, particularly in scenarios with a vast number of speaker models.

Methods

The core innovation is the Speaker Ranking Selection (SRS) method. Instead of relying on a normalized score threshold, SRS determines a speaker's identity based on the rank of their model's likelihood score within a large pool of speaker models.

Here's how it works:

  • Training Stage: Standard speaker models are built for each target speaker. A large pool of background (impostor) models is also created.
  • Testing Stage:
    1. The system calculates the likelihood of the test speech belonging to the target speaker model and all background speaker models.
  • These likelihoods are ranked in descending order, creating a "speaker ranking list."
    1. A decision is made based on whether the target speaker's rank falls within a predefined rank threshold (OR). The authors hypothesize that rank is more robust to score variability than normalized scores.

To address the computational cost of calculating likelihoods against a massive number of models, the authors propose a data-driven approach for speaker model selection. This is a speed-up technique for the testing stage:

  • During training, for each target speaker, a subset of "cohort" speaker models (r-closest models based on likelihoods) is selected. This subset, denoted as $T_c$, is used during testing.
  • This reduces the number of models that need to be evaluated from the total pool ($N$) to the size of the cohort subset ($r_c$), significantly speeding up computation.

Datasets

The experiments were conducted using the large-scale Japanese speaker recognition evaluation corpus constructed by the National Research Institute of Police Science, Japan.

  • Corpus Details: Recorded via bone-conduction and air-conduction microphones, and over cell phones. It includes utterances from 283 Japanese males aged 18-76. Each speaker uttered 50 phonetically balanced sentences, recorded twice in two sessions separated by 2-3 months.
  • Training Data: 5 sentences from the first round of the first session for each speaker.
  • Testing Data: The remaining 45 utterances from the first and second sessions.
  • Background Models: All speakers' models except the target model were used as background models ($N=282$).

Key Insights and Ideas

  • Rank as a Robust Metric: The core idea that using the rank of a speaker's model, rather than a normalized score, can lead to more stable and accurate verification is a key insight. Ranks are inherently less sensitive to subtle score fluctuations.
  • Computational Efficiency through Cohort Selection: The data-driven cohort selection is crucial. It demonstrates that you don't need to compare against every possible impostor model; a carefully selected subset can yield similar or better results with drastically reduced computation.
  • Trade-off Between Cohort Size and Accuracy: The experiments show that while a larger cohort size (closer to the full set of models) generally leads to better accuracy, there's a point of diminishing returns. Smaller, well-chosen cohorts can offer a good balance.
  • Stability Across Sessions: The proposed SRS method shows improved performance and stable False Acceptance Rates (FAR) even when comparing utterances from different recording sessions (months apart), suggesting robustness to temporal variations.

Key Results

  • Improved Accuracy: The SRS method achieved a lower Equal Error Rate (EER) of 2.17% and a lower minimum Decision Cost Function (minDCF) of 0.0092 compared to the traditional T-norm method (EER 2.72%, minDCF 0.0154) on the large-scale Japanese corpus.
  • Significant Speedup: The data-driven approach reduced computation time by approximately 1/5 compared to the original SRS method, by reducing the number of models evaluated from $N$ to $r_c$.
  • Cohort Size Impact: For the data-driven approach, cohort sizes of 35, 70, and 283 showed very similar accuracy. The best accuracy was achieved with the full cohort size (283).
  • Session Variability: While performance degraded slightly for different sessions (FRR increased by 40-25%), the SRS method still showed improvement over T-norm and maintained stable FAR across sessions.

Limitations and Future Work

  • Computational Cost (Original SRS): The original SRS method, while accurate, requires significant computation time as it needs to calculate likelihoods against all $N$ models. The data-driven approach mitigates this.
  • Future Work: The authors plan to integrate the rank-based approach with normalized scores, as the error tendencies of the two techniques differ, suggesting a hybrid approach might offer further improvements.

Summary updated

BibTeX
@inproceedings{okamoto2009text,
  author = {Haruka Okamoto and Satoru Tsuge and Amira Abdelwahab and Masafumi Nishida and Yasuo Horiuchi and Shingo Kuroiwa},
  title = {{Text-independent speaker verification using rank threshold in large number of speaker models}},
  booktitle = {Interspeech},
  year = {2009},
}
Figure