Behavioral Paradigms for Measuring Speech Intelligibility

25 concepts26 papers1 proposal

Speech intelligibility is not merely a static property of an audio signal; it is a dynamic mapping between physical acoustic features and the human auditory system's capacity to decode phonetic information. While objective signal-to-noise ratios (SNRs) or algorithmic metrics can estimate signal degradation, true intelligibility must be measured behaviorally.

To understand why and how speech remains comprehensible across diverse distortions—such as background noise, synthetic voice cloning, or clinical hearing loss—researchers use structured behavioral paradigms. By systematically controlling the linguistic context and response formats, these paradigms isolate specific cognitive and perceptual mechanisms.

Tracking Thresholds via the Speech Reception Threshold

When evaluating how robust speech is against background noise, measuring accuracy at a single, fixed noise level provides an incomplete picture. Human speech perception does not degrade linearly; instead, it follows a sigmoidal psychometric curve where a small change in noise can cause a massive drop in comprehension.

To capture this non-linear behavior, researchers frequently measure the Speech Reception Threshold (SRT). The SRT is defined as the exact SNR at which a listener correctly recognizes 50% of the target speech material. By fitting a psychometric function to performance data across varying noise levels, researchers can precisely quantify how much acoustic stress a listener or system can tolerate before comprehension collapses.

Human Performance Psychometric Curve
100% |          /-------------
     |         /
 50% |--------/. <--- Speech Reception Threshold (SRT)
     |       /
  0% |______/_________________
     Quiet                 Noisy (SNR)

This threshold approach allows for precise benchmarking across human and machine listeners. For instance, Dirk Hoffner et al. utilized SRTs in Hearing deficits of transformer-based ASR for anechoic and spatial signals to reveal that even advanced automatic speech recognition models like Whisper exhibit "hearing deficits" compared to humans when processing semantically unpredictable sentences in reverberant rooms.

The SRT framework is equally powerful for evaluating generative audio technologies and clinical interventions. Lidea Shahidi et al. used SRT psychometric functions in Harnessing Text-to-Speech Voice Cloning Models for Improved Audiological Speech Assessment to verify whether cloned synthetic voices preserve the exact audiological profiles of standard human speech tests. In clinical engineering, Mingyue Shi et al. applied SRT testing in DBD-CI: Doubling the Band Density for Bilateral Cochlear Implants to demonstrate how doubling frequency band density shifts the noise tolerance threshold for implant users. By tracking the 50% threshold rather than absolute accuracy, researchers like Rosemary Orr et al. in An international English speech corpus for longitudinal study of accent development can quantitatively monitor subtle shifts in intelligibility over time, such as the gradual convergence of non-native accents.

Isolating Phonetics via Closed-Set Rhyme Tests

Open-ended transcription tasks introduce a major confounding variable: top-down cognitive guessing. If a listener hears "The cat sat on the [noise]", they can easily infer the missing word using semantic and grammatical context, masking a failure in their actual bottom-up acoustic perception.

To strip away semantic context and isolate raw phonetic discrimination, researchers use closed-set forced-choice paradigms, most notably the Diagnostic Rhyme Test (DRT) and the Modified Rhyme Test (MRT). In these tasks, listeners hear an isolated target word and must choose from a small set of rhyming options that differ by only a single phoneme (e.g., distinguishing "cat" from "bat" to test initial consonant voicing). Because the options are known and phonetically constrained, the resulting error rates directly map to specific consonantal or vowel confusions.

Closed-Set Forced Choice (e.g., MRT / Minimal Pairs)
Audio Stimulus: "Voiced or Unvoiced?" ---> Listener Choice: [  BAT  ] vs [  PAT  ]
(Isolates bottom-up acoustic features by removing sentence-level context clues)

This precise isolation makes rhyme tests ideal for evaluating speech enhancement hardware and algorithms. Thomas Joubaud et al. deployed the MRT in French Listening Tests for the Assessment of Intelligibility, Quality, and Identity of Body-Conducted Speech Enhancement to determine exactly how well deep-learning models restore degraded consonantal boundaries in body-conducted audio. Similarly, Kazuhiro Kondo et al. used the DRT in Speech intelligibility of diagonally localized speech with competing noise using bone-conduction headphones to measure how spatial separation interacts with bone-conduction physics at the phonemic level.

The closed-set paradigm is highly adaptable across populations and applications:

Eliminating Lexical Bias via Nonsense Words

While closed-set rhyme tests remove sentence-level semantic context, they still rely on real words, meaning a listener's vocabulary size or word-frequency biases can still skew the results. To completely isolate bottom-up acoustic-phonetic transmission, researchers eliminate lexical meaning entirely by using nonsense words or logatomes (phonetically permissible but meaningless sound structures, like "bap" or "gost").

By forcing the brain to process speech sounds without any matching entry in the mental lexicon, logatomes reveal the raw fidelity of an audio channel. Hanna Silen et al. embedded nonsense words within carrier sentences in Evaluation of Finnish unit selection and HMM-based speech synthesis to expose the precise acoustic stitching flaws of unit-selection versus HMM-based speech synthesis systems.

Similarly, Laura Fernández Gallardo et al. leveraged synthesized logatomes in Importance of intelligible phonemes for human speaker recognition in different channel bandwidths to map out how specific acoustic bandwidths support human perception. Their work demonstrated that transitioning from narrowband to wideband channels disproportionately benefits high-frequency fricatives like /f/ and /s/, directly linking physical channel properties to human phonetic recognition.

Measuring Message Preservation via Keyword Recall

When researchers want to evaluate high-level message comprehension or real-world communication rather than isolated phonemic boundaries, they turn to open-set keyword recall and sentence transcription. In this paradigm, listeners hear full sentences and must verbally repeat or transcribe the message, with performance scored by the percentage of correctly identified keywords.

Keyword recall captures how acoustic variations interact with cognitive load, working memory, and real-world listening environments. For example, Xihong Wu et al. used word identification in Effect of number of masking talkers on speech-on-speech masking in Chinese to map out the exact transition from energetic masking to informational masking as the number of competing background talkers increases.

Open-Set Keyword Recall
Audio: "The standard REPORT was signed by the DIRECTOR."
Listener Transcribes -> "The standard support was signed by the director."
Score: 1 out of 2 Target Keywords Correct (Exposes semantic/lexical integration)

This paradigm is highly effective for exposing where speech technologies fail to preserve linguistic information:

Uncovering Hidden Cognitive Load

A major advantage of keyword recall is that it can be paired with physiological or neuroadaptive measures to reveal the hidden cognitive costs of degraded speech. A listener might achieve 100% keyword accuracy on a distorted audio track, but doing so might require immense mental effort that exhausts working memory.

To capture this hidden strain, Maximillian Paulus et al. paired keyword recall with pupillometry in Talker Intelligibility and Listening Effort with Temporally Modified Speech. They discovered that temporally warping speech—whether speeding it up or slowing it down—significantly increases pupil dilation, proving that non-standard speech rates demand heightened cognitive listening effort even when behavioral recall scores remain high.

Similarly, Louise Stringer et al. combined keyword recognition in noise with electroencephalography (EEG) in The effect of regional and non-native accents on word recognition processes: a comparison of EEG responses in quiet to speech recognition in noise. Their neural recordings revealed that processing accented speech alters fundamental phonological and semantic integration in the brain, even in quiet conditions where behavioral transcription scores show no apparent deficit.

In clinical settings, Huiwen Goy et al. used sentence-based word identification in Effect of within- and between-talker variability on word identification in noise by younger and older adults to show that older adults benefit disproportionately from the Lombard effect (speech naturally produced in noise), suggesting that standard audiological tests in quiet environments often overestimate age-related communication difficulties.

Finally, keyword tracking exposes the boundaries of sensory prosthetics. Sara Akbarzadeh et al. paired keyword identification with EEG in The Implication of Sound Level on Spatial Selective Auditory Attention for Cochlear Implant Users: Behavioral and Electrophysiological Measurement to prove that increasing sound volume actually harms selective auditory attention for cochlear implant users.

To understand why these clinical simulations sometimes fail to mimic real-world performance, Fanhui Kong et al. used open-set sentence transcription in Cochlear-implant Listeners Listening to Cochlear-implant Simulated Speech, demonstrating that implant users can easily distinguish natural speech from vocoded speech across various channel counts. This highlights that acoustic models often fail to capture the true perceptual reality of clinical devices.

By selecting the appropriate behavioral paradigm—whether tracking psychometric thresholds via SRT, isolating phonemes via closed-set rhyme tests, removing lexical bias via nonsense words, or measuring cognitive load via keyword recall—researchers can look past raw audio signals to understand how the human mind extracts meaning from sound.

Key Foundational Work

Effect of number of masking talkers on speech-on-speech masking in Chinese (2007) — contributed 1 concept elements to this direction.
A user study on the influence of mobile device class, synthesis method, data rate and lexicon on speech synthesis quality (2005) — contributed 1 concept elements to this direction.
Effect of within- and between-talker variability on word identification in noise by younger and older adults (2007) — contributed 1 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_speech_intelligibility_measurement_1cb92339,
  title = {speech intelligibility measurement},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/speech-intelligibility-measurement/rdr_1cb92339203e443fb131c53dfc613cfc},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 1, frozen text):

@misc{lacuna_speech_intelligibility_measurement_1cb92339_v1,
  title = {speech intelligibility measurement},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/speech-intelligibility-measurement/rdr_1cb92339203e443fb131c53dfc613cfc/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake