Identifying and typifying demographic unfairness in phoneme-level embeddings of self-supervised speech recognition models

Felix Herron, Solange Rossato, Alexandre Allauzen, François PortetarXiv 2026 · arXiv

TL;DR

This paper investigates why automatic speech recognition (ASR) systems exhibit demographic unfairness by analyzing phoneme embeddings across different speaker groups. The authors reveal that this disparity is primarily driven by unequal random noise (high variance) in how certain groups' voices are modeled, rather than systematic embedding bias. Consequently, standard fairness interventions that target bias fail to bridge the performance gap.

What Problem Does This Paper Address?

While modern ASR systems have achieved remarkable performance gains, they don't work equally well for everyone. Persistent performance gaps remain across different speaker groups (SGs) based on gender, age, dialect, and ethnicity.

Existing fairness research often treats ASR models as "black boxes," attempting to fix disparities without understanding the underlying failure mechanisms. This paper opens up the hood of self-supervised speech processing models (S3Ms) to analyze their latent phoneme embeddings. Specifically, the authors look at two distinct types of modeling errors:

  1. Embedding Bias (Systematic Error): The model maps phonemes to entirely different regions of the embedding space depending on who is speaking.
  2. Unequal Variance (Random Error): The model maps phonemes to the correct general region for all groups, but the representations for disadvantaged groups are significantly noisier and more scattered.
Figure 1: Toy visualization of high variance vs embed- ding bias in by-SG modeling of phonemes, along with corresponding linear separators trained on the SG of the corresponding cover (orange trained on both SGs). If, compared to an equal-error world (upper left), the S3M embeds phonemes from SG ’B’ with higher variance than SG ’A’ (upper right), the learned ASR head won’t necessarily learn a different transformation (thought it might due to the training data being less noisy) but it will return higher error rate for SG ’B’. However, if phoneme 1 is modeled about different modes depend- ing on SG, representing embedding bias (lower left), this will bias the PR head towards the more heavily rep- resented SG in the training set.

Methods

The authors propose a geometric framework to isolate and measure these two error types:

  • Phoneme Recognition (PR) Probing: The authors train simple linear classifiers (probes) on top of frozen layers of speech encoder models. They compare probes trained on a single speaker group (e.g., only female speakers) against probes trained on a demographically balanced dataset. If in-domain training resolves the performance gap, it indicates systematic bias. If the same groups perform poorly regardless of the training distribution, it points to high variance.
  • K-Nearest Neighbors (KNN) Distance Heuristic: To directly quantify random error, they calculate the geometric tightness of phoneme clusters in the embedding space using the squared L2 distance to a sample's nearest neighbors. A higher KNN distance signifies a looser, noisier cluster.
  • Evaluating Adversarial Finetuning: They test whether Domain Enhancing/Adversarial Training (DET/DAT)—a popular fairness technique designed to strip speaker identity from model representations—actually reduces embedding variance or bias.

Datasets

  • Sonos Voice Control Bias Assessment Dataset: The primary dataset used for probing and variance analysis. It contains clean, high-fidelity recordings with precise demographic metadata spanning gender, age, dialect, and ethnicity. The authors carefully filtered and aggregated categories to isolate single demographic variables and avoid confounding factors.
  • CommonVoice 16: A subset of 1,500 speakers was utilized to finetune the backbone encoder models on a standard ASR task.

Key Insights and Ideas

  • Variance Over Bias: In the deeper layers of speech models (where actual speech recognition decisions are shaped), systematic embedding bias mostly disappears, yet unequal variance remains high. Models don't necessarily misalign a demographic group's phonemes in a structured way; rather, the representations for groups like children or non-native speakers are inherently more scattered.
  • Why Fairness Fixes Fail: Common adversarial training techniques (DET/DAT) are designed to eliminate speaker-group bias by making embeddings indistinguishable across groups. However, because the real culprit behind ASR unfairness is variance, these techniques target the wrong problem, explaining their historically mediocre results.
  • Orthogonal Spaces: The findings reinforce prior theories that phoneme features and speaker identity are processed in orthogonal subspaces within neural networks. Stripping speaker identity via adversarial training does not automatically clean up or stabilize the noisy phoneme space.

Key Results

  • Consistent Hierarchy: Native speakers, adults, and Caucasians consistently achieved the highest phoneme recognition accuracy and lowest embedding variance across all six tested encoder architectures (including WavLM, Wav2vec 2.0, and Whisper).
  • The Variance-Error Link: The authors found a statistically significant correlation ($p < 0.001$) between high KNN distance (looser clusters) and poor phoneme classification accuracy across every speaker group and model.
Figure 2: Absolute F1 score at every layer for each phoneme of each ASR-finetuned encoder model.
  • Ineffectiveness of DET/DAT: Applying adversarial training changed neither the relative KNN distances between phonemes nor the minor benefits observed from in-domain probe training.

Limitations and Future Work

  • Dataset Cleanliness: The Sonos dataset consists of clean, controlled recordings. Real-world ASR deployment involves background noise and varying microphone quality, which might introduce different error dynamics.
  • Model Scale: The study evaluated models with 100M to 300M parameters. State-of-the-art massive models (like Whisper-large) might exhibit different embedding behaviors.
  • Alignment Noise: The phoneme boundaries were extracted using automated forced alignment tools, which can inherently introduce demographic bias and noise into the evaluation pipeline.
  • Future Direction: The authors suggest moving away from adversarial bias-removal and instead focusing on geometric stabilization techniques—such as Siamese networks or supervised contrastive learning—to explicitly minimize embedding variance for disadvantaged speaker groups.

Summary updated

Abstract

Modern automatic speech recognition (ASR) systems have been observed to function better for certain speaker groups (SGs) than others, despite recent gains in overall performance. One potential impediment to progress towards fairer ASR is a more nuanced understanding of the types of modeling errors that speech encoder models make, and in particular the difference between the structure of embeddings for high-performance and low-performance SGs. This paper proposes a framework typifying two types of error that can occur in modeling phonemes in ASR systems: random error/high variance in phoneme embedding, vs systematic error/embedding bias. We find that training phoneme classification probes only on a single, typically disadvantaged SG, sometimes improves performance for that SG, which is evidence for the existence of SG-level bias in phoneme embeddings. On the other hand, we find that speakers and SGs with higher levels of phoneme variance are the same as those with worse phoneme prediction accuracy. We conclude that both types of error are present in phoneme embeddings and both are candidate causes for SG-level unfairness in ASR, though random error is likely a greater hindrance to fairness than systematic error. Furthermore, we find that finetuning encoder models using a fairness-enhancing algorithm (domain enhancing and adversarial training) changes neither the benefits of in-domain phoneme classification probe training, nor measured levels of random embedding error.
BibTeX
@misc{herron2026identifying,
  author = {Felix Herron and Solange Rossato and Alexandre Allauzen and François Portet},
  title = {{Identifying and typifying demographic unfairness in phoneme-level embeddings of self-supervised speech recognition models}},
  year = {2026},
  eprint = {2604.22631},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2604.22631},
}

Loading related content...

Figure