Prosodic Characteristics of Mandarin Declarative and Interrogative Utterances in Parkinson’s Disease

Lei Liu, Meng Jian, Wentao GuInterspeech 2019

TL;DR

This study investigates how Parkinson's disease (PD) affects the prosody (intonation and rhythm) of Mandarin speakers when distinguishing between statements and questions. The findings reveal that PD patients struggle to use pitch variations to signal question intent, unlike healthy controls, suggesting a degradation in their ability to control fundamental frequency for this linguistic task.

What Problem Does This Paper Address?

Communicating effectively relies heavily on prosody – the rhythm, stress, and intonation of speech. In many languages, questions are marked by distinct pitch patterns compared to statements. Mandarin, in particular, uses a global rise in pitch for questions, starting at a higher fundamental frequency (F0) than statements. Parkinson's disease (PD) is known to cause hypokinetic dysarthria, affecting speech production, and previous research on its impact on prosody has yielded inconsistent results. This paper aims to clarify how PD affects the production of these crucial prosodic distinctions in Mandarin, specifically focusing on the differences between declarative and interrogative utterances, and how sentence length and final tones play a role.

Methods

The researchers employed a combination of acoustic analysis techniques and statistical modeling.

  • Acoustic Feature Extraction: They meticulously extracted various prosodic features from recorded speech, including:
  • F0 (Fundamental Frequency): Measured globally (across non-final syllables) and finally (on the last syllable) to capture pitch contours.
  • Speech Rate: Assessed through syllable duration (global and final).
  • Intensity Ratio: The ratio of the first syllable's intensity to the final syllable's intensity was analyzed.
  • Statistical Modeling:
    • Smoothing Spline ANOVA (SS-ANOVA): Used to visualize and compare the F0 contours between groups and conditions, highlighting significant differences where confidence intervals did not overlap.
  • Linear Mixed-Effects Models (LMM): Applied to analyze the extracted acoustic parameters. LMMs are powerful for handling hierarchical data (like repeated measures from subjects) and can account for individual differences. They included fixed effects (group, sentence type, sentence length, final tone, and their interactions) and random effects (subject intercepts and slopes) to model the data.

Datasets

The study utilized a custom-designed dataset of Mandarin sentences.

  • Participants: 20 native Mandarin speakers with idiopathic Parkinson's disease (PD) and 20 age- and gender-matched healthy controls (HC).
  • Stimuli: A set of 32 utterances per participant, varying in sentence type (declarative vs. interrogative), sentence length (3, 5, 7, or 9 syllables), and sentence-final tone (T1, T2, T3, or T4).
  • Total Utterances: 1280 target utterances were extracted for analysis (40 participants * 2 sentence types * 4 sentence lengths * 4 final tones).
  • Recording: Speech data was collected in a quiet room using a digital recorder, with PD patients recorded in their medication-off state.

Key Insights and Ideas

  • Impaired Question Intonation in PD: The most striking finding is that PD speakers, unlike healthy controls, do not show a significant difference in F0 level between statements and questions. This suggests a fundamental difficulty in using pitch to signal interrogative intent in Mandarin.
  • Global F0 Planning Difficulty: The global F0 planning required for Mandarin questions (starting at a higher pitch) appears to be particularly challenging for PD patients, potentially due to weakened laryngeal control and reduced motor planning.
  • Faster Speech Rate in PD: PD speakers exhibited a faster speech rate, especially in the final syllable, indicating degraded articulatory control towards the end of utterances.
  • Steeper Pitch Slope in PD: PD speakers also showed a steeper F0 slope, contributing to an impression of "hurrying" through utterances, likely reflecting reduced laryngeal control and motor planning.
  • Language-Specific Challenges: The study highlights how language-specific prosodic features (like Mandarin's global F0 rise for questions) can expose specific deficits in PD speech.

Key Results

  • F0 Contours (SS-ANOVA): Healthy controls (HC) showed clear F0 differences between statements and questions, with questions having higher F0. PD speakers, however, exhibited no significant F0 difference between sentence types, and their overall F0 level was generally lower than HCs.
  • F0 Global (LMM): LMM analysis confirmed a significant interaction between group and sentence type. HCs showed significantly higher global F0 for questions than statements, while PDs did not.
  • F0 Final (LMM): A significant interaction between group, sentence type, and sentence length was found for final F0. HCs consistently showed higher final F0 for questions across sentence lengths, while PDs only showed this difference in 3-syllable sentences.
  • Speech Rate (LMM): The PD group had significantly shorter global syllable durations (faster speech rate) than the HC group, particularly in the final syllable.
  • Pitch Slope (LMM): PD speakers had a steeper global F0 slope compared to HCs, indicating a more rapid pitch descent.

Limitations and Future Work

  • Inconsistent F0 Findings: The paper acknowledges that LMM analysis of F0_global did not find a significant difference between groups, which conflicted with SS-ANOVA results. This discrepancy is attributed to the different ways random effects are handled in the models, suggesting that future studies with larger samples are needed for more reliable conclusions on overall F0 levels.
  • Complexity of PD: The authors note the inherent complexity of PD and the large individual differences among patients, which can make drawing definitive conclusions challenging.
  • Future Directions: The study suggests that more complex speech tasks should be incorporated into the assessment of PD speech. Furthermore, the findings imply that more sophisticated automatic evaluation systems for PD speech should consider these nuanced prosodic deficits. The authors also propose that future research should investigate the impact of levodopa treatment on these prosodic features.

Summary updated

BibTeX
@inproceedings{liu2019prosodic,
  author = {Lei Liu and Meng Jian and Wentao Gu},
  title = {{Prosodic Characteristics of Mandarin Declarative and Interrogative Utterances in Parkinson’s Disease}},
  booktitle = {Interspeech},
  year = {2019},
}
Figure