TL;DR
This paper investigates how subtle changes in voice quality, specifically the degree of vocal fold periodicity and the presence of creaky voice, act as cues for turn-taking and distinguishing between different types of affirmative responses in conversation. The findings suggest that these voice quality features are cross-linguistically relevant for turn-taking but may be more language-specific for differentiating affirmative cues.
What Problem Does This Paper Address?
Conversations are complex, dynamic interactions where participants constantly signal their intentions to speak, yield the floor, or acknowledge the current speaker. While pitch and loudness variations (prosody) are well-known cues for these turn-taking and pragmatic functions, the role of voice quality – the acoustic characteristics of the vocal fold vibration itself – has been less explored, especially for continuous speech. This paper aims to fill this gap by examining how voice quality dynamics, specifically the periodicity of the voice source and the presence of creaky voice, function as cues in two key conversational scenarios: signaling turn-taking transitions (smooth switches, holds, and backchannels) and differentiating between affirmative cue words (ACWs) like "uh-huh" or "okay" when used for agreement, acknowledgement, or backchanneling.
Methods
The researchers employed acoustic voice quality (VQ) measures that are better suited for continuous speech compared to older methods. The primary measures used were:
- Cepstral Peak Prominence Smooth (CPPS): This metric quantifies the degree of periodicity in the speech signal by measuring the prominence of the main peak in the cepstrum. Higher CPPS generally indicates a more periodic, clearer voice.
- Creak Detection: This method identifies regions in the speech signal where the vocal folds vibrate irregularly, producing a "creaky" or "vocal fry" sound.
These features were extracted from specific segments of speech: the 500 ms preceding silences in turn-taking transitions and the entire duration of affirmative cue words. The data was then analyzed using multinomial logistic regression to determine the predictive power of CPPS and Creak for the different conversational functions.
Datasets
The study utilized data from three speech corpora:
- American English: Data from the Objects games in the Columbia Games Corpus.
- Argentine Spanish: Adapted versions of the Objects games.
- Slovak: Data from previous studies on Slovak backchannels.
These corpora were chosen for their existing annotations of turn-taking transitions and affirmative cue words, allowing for the analysis of these specific conversational phenomena.
Key Insights and Ideas
- Periodicity as a Universal Turn-Taking Cue: Lower vocal fold periodicity (indicated by lower CPPS and/or higher creak) appears to be a consistent cue for smooth turn switches across the studied languages. This suggests a cross-linguistic tendency to signal a willingness to yield the floor through a less periodic voice.
- Creaky Voice's Nuanced Role: While lower periodicity is generally associated with smooth switches, the role of creaky voice itself is more complex. It can contribute to lower periodicity but its specific contribution to turn-holding versus turn-yielding can vary.
- Language Specificity in Affirmative Cues: The way voice quality differentiates affirmative cue words (like "uh-huh" or "okay") seems to be more language-dependent. American English speakers might use lower periodicity for agreement/acknowledgement compared to backchannels, while Slovak speakers show a reversed pattern.
- Beyond Jitter and Shimmer: The study advocates for using measures like CPPS and creak detection over older perturbation measures (jitter, shimmer, NHR) for analyzing voice quality in continuous speech, as they are more robust and informative.
Key Results
- Turn-Taking: In American English, lower CPPS and higher creak were associated with smooth switches (S) compared to holds (H). For Argentine Spanish and Slovak, lower CPPS consistently predicted smooth switches over holds. The role of creak in predicting backchannels was less consistent across languages.
- Affirmative Cue Words (ACWs): In American English, lower CPPS and higher creak were associated with acknowledgement/agreement (Ack/Agr) compared to backchannels (BC). In Slovak, the pattern was reversed, with lower CPPS associated with backchannels (BC) compared to acknowledgements (Ack) and agreements (Agr).
Limitations and Future Work
- Limited ACW Categories: The study focused on a subset of the most frequent ACW tokens and collapsed some categories, particularly in the Slovak data. Future work could explore a broader range of ACW types and finer distinctions.
- Cross-Cultural Nuances: While the study included three languages, it acknowledges that pragmatic distinctions conveyed by VQ might be even more language and culture-specific than observed. Further research with more diverse languages and cultural contexts is warranted.
- Correlation vs. Causation: The study identifies correlations between VQ features and conversational functions. While suggestive, further experimental work could explore causal relationships.
- Integration with Other Prosodic Features: The paper focuses on VQ, but acknowledges that it works in conjunction with other prosodic features (pitch, loudness). Future research could investigate these interactions more deeply.
Summary updated