Modelling speech line spectral frequencies with dirichlet mixture models

Zhanyu Ma, Arne Leijon

Introduction

In modern speech coding, representing the spectral envelope—the general shape of a voice's frequency spectrum—is a fundamental task. The industry standard for this representation is Line Spectral Frequencies (LSFs). LSFs are physically constrained parameters: they are strictly bounded within the range of $(0, \pi)$ and are always ordered ($s_1 < s_2 < \dots < s_K$).

Historically, Gaussian Mixture Models (GMMs) have been the tool of choice for modeling the probability density of these parameters. However, GMMs are defined over an infinite domain, which creates a mathematical mismatch with the bounded nature of LSFs. This often results in GMMs assigning probability mass to impossible frequency values, leading to inefficiencies in speech compression and quantization.

Methodology: The Dirichlet Advantage

This paper proposes a shift from GMMs to Dirichlet Mixture Models (DMMs), which are inherently suited for data that exists on a simplex. The authors achieve this by transforming raw LSFs into $\Delta$LSFs—the differences between adjacent frequencies. Because LSFs are ordered and bounded, these differences are always positive and sum to a constant ($\pi$). By normalizing these differences to sum to 1, the data perfectly fits the requirements of a Dirichlet distribution.

To handle the complexity of speech, the authors employ a mixture of Dirichlet distributions (DMM) and adapt the Expectation-Maximization (EM) algorithm for parameter estimation. Furthermore, they derive the high-rate Distortion-Rate (D-R) relationship for the Dirichlet distribution, enabling optimized bit-allocation strategies for vector quantization.

Modeling Accuracy and Efficiency

The proposed model was evaluated using the TIMIT database, comparing a DMM approach against a traditional diagonal-covariance GMM. A key insight of the study is that the DMM is more "geometrically aligned" with the data. While a GMM attempts to fit a rectangular model to a triangular (simplex) data space, the DMM matches the data's natural shape.

Log-likelihood and BIC comparison

As shown in Figure 1, the DMM consistently achieves higher log-likelihood values than the GMM. Even when using the Bayesian Information Criterion (BIC) to penalize for model complexity, the DMM remains superior. This indicates that the DMM is not merely overfitting but is providing a fundamentally more accurate description of speech physics with fewer parameters.

Quantization Performance

The practical impact of this modeling shift is most evident in quantization performance. In speech coding, the Distortion-Rate (D-R) ratio is the critical metric for efficiency.

Distortion-Rate relation for I=8

Figure 2 demonstrates that the DMM-based vector quantizer significantly outperforms the GMM-based approach. Across various bit rates, the DMM achieves a gain of approximately 3.85 dB to 3.92 dB. In the context of speech codecs, a ~4 dB improvement represents a substantial leap in performance, allowing for higher audio quality at lower bit rates.

Conclusion and Future Work

By replacing GMMs with DMMs, the authors have introduced a more mathematically natural and efficient way to model speech spectral data. The DMM's ability to respect the physical constraints of LSFs leads to significant gains in both modeling accuracy and quantization performance.

Despite these successes, challenges remain. The mathematical dependency between $\Delta$LSF components (the fact that they must sum to 1) makes it difficult to apply standard scalar quantization or decorrelation techniques like the Karhunen-Loève Transform (KLT). Developing low-complexity scalar quantizers that leverage the DMM's strengths remains an open area for future research.

Summary updated

Abstract

In this paper, we model the underlying probability density function (PDF) of the speech line spectral frequencies (LSF) parameters with a Dirichlet mixture model (DMM). The LSF parameters have two special features: 1) the LSF parameters have a bounded range; 2) the LSF parameters are in an increasing order. By transforming the LSF parameters to the ?LSF parameters, the DMM can be used to model the ?LSF parameters and take the advantage of the features mentioned above. The distortion-rate (D-R) relation is derived for the Dirichlet distribution with the high rate assumption. A bit allocation strategy for DMM is also proposed. In modelling the LSF parameters extracted from the TIMIT database, the DMM shows a better performance compared to the Gaussian mixture model, in terms of D-R relation, likelihood and model complexity. Since modelling is the essential and prerequisite step in the PDF-optimized vector quantizer design, better modelling results indicate a superior quantization performance.
BibTeX
@inproceedings{ma2010modelling,
  author = {Zhanyu Ma and Arne Leijon},
  title = {{Modelling speech line spectral frequencies with dirichlet mixture models}},
  booktitle = {Interspeech},
  year = {2010},
  doi = {10.21437/interspeech.2010-648},
}
Figure