Acoustic features for robust classification of Mandarin tones

Hongbing Hu, Stephen A. Zahorian, Peter Guzewich, Jiang WuInterspeech 2014 · DOI

Introduction

In tonal languages like Mandarin, the fundamental frequency ($F_0$) or pitch contour is the primary carrier of lexical meaning. Automatic speech recognition (ASR) systems often struggle with Mandarin because pitch tracking is highly sensitive to noise and band-limiting effects, such as those found in telephone communications. This paper presents a robust framework for Mandarin tone classification using an enhanced version of the YAAPT (Yet Another Algorithm for Pitch Tracking) algorithm combined with spectral shape features.

Methodology: Enhanced Pitch Tracking and Spectral Features

The researchers' approach rests on two technical pillars: a modified YAAPT algorithm and the inclusion of spectral temporal features.

The YAAPT Framework

YAAPT is a hybrid pitch tracker that operates in both the time and frequency domains. The authors introduced several critical modifications to improve its robustness for tone recognition:

  • Smooth Interpolation: To handle unvoiced segments that typically cause "glitches" in trackers like YIN or PRAAT, the authors employed cubic polynomial interpolation. This creates a continuous, "all-voiced" pitch track that is more suitable for neural network classifiers.
  • Candidate Refinement: The alignment between temporal and spectral pitch candidates was improved to minimize errors stemming from frequency resolution limits.
  • Efficiency: Code optimizations resulted in a 25% reduction in processing time.
Figure 1: Flowchart of the enhanced YAAPT pitch tracking algorithm, showing the integration of temporal and spectral analysis.

Spectral Temporal Features

Beyond $F_0$, the authors utilized Discrete Cosine Transform Coefficients (DCTCs) to capture the shape of the low-frequency spectrum and Discrete Cosine Series Coefficients (DCSCs) to model temporal changes. These features provide a global acoustic context that complements the pitch contour.

Experimental Results

The system was evaluated using the RASC863 Mandarin Chinese corpus, focusing on the four primary Mandarin tones. Features were processed through a multilayer feed-forward neural network.

Classification Performance

The results demonstrate that the combination of robust pitch tracking and spectral features significantly enhances classification accuracy. A key finding was the importance of temporal context; accuracy consistently improved as the analysis window was extended from 100ms to 800ms.

Figure 5: Comparison of classification accuracy for YAAPT and YIN across different segment lengths and feature combinations.

As shown in the performance metrics, the integrated system achieved a peak classification accuracy of 76.9%, outperforming YIN by 4.1% and PRAAT by 5%. Notably, this performance exceeds the ~75% accuracy typically observed in human listeners identifying isolated tonal syllables.

Conclusion

By addressing the "unvoiced gap" through smart interpolation and integrating spectral shape trajectories, the authors developed a system that maintains high accuracy even in "dirty" or telephone-quality audio. While future work will address the complexities of continuous speech and co-articulation, these results set a new benchmark for robust Mandarin tone recognition.

Summary updated

BibTeX
@inproceedings{hu2014acoustic,
  author = {Hongbing Hu and Stephen A. Zahorian and Peter Guzewich and Jiang Wu},
  title = {{Acoustic features for robust classification of Mandarin tones}},
  booktitle = {Interspeech},
  year = {2014},
  doi = {10.21437/interspeech.2014-334},
}
Figure