Abstract
This study investigates the relationship between perceived syllable prominence and various articulatory and prosodic cues in emotional speech. Utilizing electromagnetic articulography (EMA) and crowd-sourced prominence transcriptions, we evaluate the Converter/Distributor (C/D) model's traditional reliance on jaw excursion. Our findings indicate that the movement of the linguistically critical articulator (CA) and root-mean-square (RMS) energy are more robust predictors of prominence than jaw movement or fundamental frequency (f0), particularly across different emotional states. These results suggest that prominence is a complex, multi-modal phenomenon requiring more nuanced modeling than conventional methods provide.
Introduction
In linguistic theory, "prominence" refers to the quality by which certain syllables or words stand out relative to their neighbors. The Converter/Distributor (C/D) model has long served as a framework for understanding the physical realization of these prosodic features, typically using "jaw excursion" as a primary proxy for syllable magnitude. However, emotional speech introduces significant variability; for instance, "cold anger" may involve a clenched jaw despite high perceived prominence. This research aims to identify more reliable articulatory and acoustic correlates of prominence across five emotional states: neutral, angry, happy, fearful, and sad.
Methodology
The study employed a multi-modal data collection strategy involving two professional speakers (one male, one female) of American English.
- Articulatory Tracking: Electromagnetic Articulography (EMA) was used to track the 3D movements of sensors placed on the tongue tip, tongue dorsum, lower lip, and jaw.
- Perceptual Annotation: Rapid Prosody Transcription (RPT) was conducted via Amazon Mechanical Turk. Twenty naive listeners marked prominent words, which were then aggregated into a "p-score" (0 to 1) for each syllable.
- Feature Extraction: The researchers extracted 27 features, including acoustic metrics (f0, duration, RMS energy) and articulatory metrics (jaw movement and the movement of the "linguistically critical articulator" specific to each phoneme).
Results and Discussion
Emotional Impact on Prominence
Statistical analysis revealed that emotional state significantly influences perceived prominence. High-arousal emotions, such as anger and happiness, consistently yielded higher p-scores compared to low-arousal states like sadness or neutral speech.
As shown in the boxplot above, the median p-score for "Angry" and "Happy" speech is visibly higher than for "Neutral" or "Sad" speech, confirming that arousal is a primary driver of perceived prominence.
Articulatory and Prosodic Correlations
The study challenged the traditional C/D model by demonstrating that the Critical Articulator (CA) often outperforms jaw movement as a predictor of prominence. Furthermore, in the prosodic domain, RMS energy (loudness) proved to be a far more consistent cue than fundamental frequency (f0).
The correlation table highlights that while f0 often shows weak correlations (frequently below 0.30), RMS energy and CA movements maintain high correlation coefficients (often exceeding 0.50 or 0.60), especially in high-arousal states like Anger for Speaker 2. This suggests that listeners rely more on intensity and specific articulatory effort than on pitch variations to identify prominent syllables in emotional contexts.
Conclusion
Our results indicate that the physical realization of prominence is a whole-mouth coordination effort rather than a simple jaw-drop mechanism. The high correlation of the Critical Articulator and RMS energy with p-scores suggests that future iterations of speech production models should incorporate a broader range of articulatory and acoustic behaviors.
Limitations of this study include the small speaker sample size and the use of linear correlation models. Future work will focus on larger datasets and non-linear statistical modeling to better capture the complex spatio-temporal relationships inherent in emotional prosody.
Summary updated