Acoustic modeling with contextual additive structure for hidden Markov model-based speech recognition

Kazuhiro Nakamura, Heiga Zen, Yoshihiro Nankaku, Keiichi TokudaThe Journal of the Acoustical Society of America 2006 · DOI

Abstract

This study proposes an acoustic modeling technique based on an additive structure of context dependencies for HMM-based speech recognition. Context dependent models, e.g., triphone HMMs, are widely employed in speech recognition systems. Generally the dependency between phonetic contexts and acoustic feature distributions is direct, i.e., if a context is given, the Gaussian distribution is specified immediately. However, more complex dependencies can be considered. This study assumes an additive structure of acoustic feature components that have different context dependencies. For example, if the left and right phones are assumed as contexts of additive components, the generative process of the triphone feature is as follows: the additive components of left and right contexts are generated independently from each distribution and then added to the monophone feature. Since the output probability distribution is composed of the sum of the mean vectors and covariance matrices of additive components, a number of different distributions can be efficiently represented by a combination of fewer distributions. However, it is unknown which kinds of contexts have additive dependencies to acoustic features. Therefore, this study proposes a context clustering algorithm for the additive structure model. The proposed algorithm automatically extracts additive components by constructing multiple decision trees simultaneously.
BibTeX
@article{nakamura2006acoustic,
  author = {Kazuhiro Nakamura and Heiga Zen and Yoshihiro Nankaku and Keiichi Tokuda},
  title = {{Acoustic modeling with contextual additive structure for hidden Markov model-based speech recognition}},
  journal = {The Journal of the Acoustical Society of America},
  year = {2006},
  doi = {10.1121/1.4787219},
}

Loading related content...

Figure