The effects of lexical tones and nasal coda /-n/ to sadness in Taiwan Hakka

Shao-ren LyuInterspeech 2012

TL;DR

This paper investigates how lexical tones and the presence of a nasal coda /-n/ in Taiwan Hakka influence the perception of sadness in non-native speakers. The study reveals that lower pitch and falling tonal contours are more strongly associated with sadness, and the nasal coda /-n/ significantly enhances this perception, acting as a crucial cue for listeners.

What Problem Does This Paper Address?

The paper delves into the fascinating area of sound symbolism, specifically how certain speech sounds might be inherently linked to emotions. While previous research has explored this connection in European languages and even touched upon it in other Asian languages like Sixian Hakka, there's a notable gap in understanding these cross-linguistic sound-emotion mappings, particularly for Taiwan Hakka. The authors aim to bridge this gap by examining how non-native speakers (Taiwan Mandarin speakers) perceive sadness when exposed to Hailu Hakka stimuli. They are interested in identifying which specific acoustic features of Hakka tones and the presence of a nasal coda contribute to this perception, and whether these findings align with or diverge from existing theories of sound symbolism.

Methods

The study employed a two-experiment design using naturally produced speech stimuli from a certified Hailu Hakka speaker.

  • Experiment 1: Focused on the effect of different lexical tones. Participants were presented with pairs of monosyllabic words, each with a different lexical tone, and asked to choose which one sounded sadder. This was a pair-wise comparison task.
  • Experiment 2: Investigated the role of the nasal coda /-n/. Participants again performed pair-wise comparisons, but this time between words with and without the /-n/ coda, while keeping the lexical tone the same.

Both experiments utilized a controlled listening environment with professional audio equipment and software for stimulus presentation and response recording. The participants were monolingual native speakers of Taiwan Mandarin with no linguistics background.

Datasets

The study used a custom corpus of Hailu Hakka monosyllabic words. These words were recorded by a native speaker in citation form, with the speaker instructed to produce them with neutral emotion. The stimuli were presented in IPA form to avoid semantic interference from Chinese characters. The paper does not introduce a new benchmark dataset but rather utilizes a carefully curated set of real words.

Key Insights and Ideas

  • Pitch Matters for Sadness: Lower average fundamental frequency (f0) values are strongly correlated with the perception of sadness in lexical tones. High-pitched tones were perceived as less sad.
  • Falling Tones Evoke Sadness: Falling tonal contours were more effective in conveying sadness than rising contours, suggesting that the direction of pitch change is a significant factor.
  • Nasal Coda /-n/ as a Sadness Amplifier: The presence of a nasal coda /-n/ consistently increased the perception of sadness across all tested lexical tones. This suggests that the nasal quality acts as a potent cue for sadness.
  • Universal Tendencies in Sound Symbolism: The findings align with broader theories of sound symbolism, indicating that certain acoustic properties of speech sounds might have cross-linguistic associations with emotions.
  • Contextual Importance of Cues: While low pitch is generally associated with sadness, the nasal coda /-n/ became a particularly important cue for participants when they were less confident about the emotional valence of a particular tone (e.g., mid-level tone 33).

Key Results

  • Lexical Tones: The low level tone (Tone 11) was most frequently identified as sad, followed by the mid-level tone (Tone 33), and then the high-level tone (Tone 55). Similarly, the low checked tone (Tone 3t) was perceived as sadder than the high checked tone (Tone 5t). The falling tone (Tone 53) was perceived as sadder than the rising tone (Tone 24).
  • Nasal Coda /-n/: Words with a nasal coda /-n/ were significantly more often chosen as sadder than words with a zero coda, regardless of the lexical tone.
  • Gender Differences: While there was a slight tendency for the nasal coda to be more effective for female participants, overall, gender differences in the perception of sadness were not statistically significant.

Limitations and Future Work

  • Stimuli Limitations: The study used monosyllabic words and a single speaker, which might limit the generalizability of the findings. The stimuli were also not synthesized, meaning natural variations could influence perception.
  • Participant Pool: The participants were all university students, which may not represent the broader population.
  • Future Work: The authors suggest further research could explore other emotions, different Hakka dialects, and the role of other phonetic features. Investigating the interaction between tone direction and pitch values more deeply is also recommended. The potential for these findings to inform speech synthesis for emotional expression is also an avenue for future exploration.

Summary updated

BibTeX
@inproceedings{lyu2012effects,
  author = {Shao-ren Lyu},
  title = {{The effects of lexical tones and nasal coda /-n/ to sadness in Taiwan Hakka}},
  booktitle = {Interspeech},
  year = {2012},
}
Figure