F0 declination in English and Mandarin broadcast news speech

Jiahong Yuan, Mark LibermanInterspeech 2010

TL;DR

This paper investigates how the fundamental frequency (F0) of speech naturally declines over an utterance in English and Mandarin Chinese broadcast news. They found a strong correlation between utterance length and the steepness of this decline, suggesting it's a speaker-controlled phenomenon. Notably, Mandarin Chinese exhibits steeper declination and a wider pitch range than English, potentially linked to its tonal nature.

What Problem Does This Paper Address?

The paper tackles the long-standing question of F0 declination in speech: is it an automatic physiological byproduct or a linguistically controlled feature? While declination (a downward trend in pitch over an utterance) is a well-observed phenomenon, its underlying causes and cross-linguistic variations are not fully understood. Previous studies often used controlled speech, which might not reflect natural speech patterns. This research aims to investigate declination in large, natural broadcast news corpora for both English and Mandarin Chinese, seeking to reveal the "true" declination effect by allowing other linguistic and situational factors to balance out. A key aspect is the cross-linguistic comparison, which has been rarely explored.

Methods

The researchers employed two primary methods:

  • Linear Regression: A standard least-squares method was used to fit a straight line to the entire F0 contour of an utterance. The slope of this line quantifies the declination. To isolate the core declination effect from initial rising and final lowering, they also fitted regression lines to the middle portion of utterances, excluding the first and last 500 ms.
  • Convex-Hull Algorithm: This algorithm, known for its success in syllable segmentation, was adapted to detect local F0 peaks and valleys. These detected peaks were connected to form the "topline" (representing the upper contour of pitch variation), and the valleys formed the "baseline" (representing the lower contour). This allowed for an analysis of how these individual contours contribute to overall declination.

Datasets

The study utilized two broadcast news speech corpora:

  • 1997 English Broadcast News Speech (LDC98S71)
  • 1997 Mandarin Broadcast News Speech (LDC98S73)

Utterances were extracted from time-stamped transcripts and filtered to include only those between 1 and 4 seconds long, excluding those with pauses longer than 50 ms and utterances from unknown speakers or reporters. This resulted in 5,652 English utterances and 8,383 Mandarin utterances.

Key Insights and Ideas

  • Utterance Length is Key: The most striking finding is the strong, consistent relationship between how long an utterance is and how steeply its F0 declines. Shorter utterances have steeper declination. This holds even when removing the initial rise and final fall, suggesting it's not just an artifact of these common pitch movements.
  • Speaker Control is Likely: The strong correlation with utterance length, especially when isolated from initial/final pitch effects, points towards declination being a speaker-controlled phenomenon rather than a purely automatic physiological process.
  • Topline and Baseline are Independent: Both the F0 peaks (topline) and valleys (baseline) show declination. Crucially, their patterns differ between English and Mandarin, suggesting they are independent phenomena and not simply byproducts of the same physiological mechanism.
  • Mandarin's Unique Profile: Mandarin Chinese exhibits more pronounced declination, wider pitch ranges, and more F0 fluctuations compared to English. This is hypothesized to be influenced by Mandarin's tonal nature.

Key Results

  • Regression Slopes: 90.7% of Mandarin utterances and 71.5% of English utterances showed negative declination slopes. Mandarin slopes were steeper than English slopes for utterances of the same length.
  • Length-Slope Correlation: The correlation between utterance length and declination slope was significant in both languages, even after excluding the first and last 500 ms of utterances.
  • Topline vs. Baseline: In English, topline and baseline patterns were similar, showing initial rising, middle declination, and final lowering. In Mandarin, the baseline was closer to a straight line, while the topline showed more distinct patterns, including final lowering.
  • Pitch Range and Fluctuations: Mandarin Chinese had a wider pitch range and more F0 fluctuations (peaks and valleys) than English, as visualized in Figures 5 and 10.

Limitations and Future Work

  • Limitations: The study acknowledges that while using large broadcast news corpora helps balance out factors, it doesn't eliminate them entirely. The exact physiological mechanisms driving declination remain an area for further investigation. The paper also notes that the "middle points" analysis excluded a full second of data, which might impact very short utterances.
  • Future Work: The authors suggest that the cross-linguistic differences in topline and baseline patterns, particularly the independence observed in Mandarin, support the idea that declination is linguistically controlled. Further research could explore how these patterns are perceived by listeners and how they might be influenced by different speech styles or genres beyond broadcast news. The role of lexical tones in Mandarin's distinct declination patterns also warrants deeper investigation.

Summary updated

BibTeX
@inproceedings{yuan2010f,
  author = {Jiahong Yuan and Mark Liberman},
  title = {{F0 declination in English and Mandarin broadcast news speech}},
  booktitle = {Interspeech},
  year = {2010},
}
Figure