Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling

Brian KingsburyICASSP 2009 · OpenReview

Abstract

Acoustic models used in hidden Markov model/neural-network (HMM/NN) speech recognition systems are usually trained with a frame-based cross-entropy error criterion. In contrast, Gaussian mixture HMM systems are discriminatively trained using sequence-based criteria, such as minimum phone error or maximum mutual information, that are more directly related to speech recognition accuracy. This paper demonstrates that neural-network acoustic models can be trained with sequence classification criteria using exactly the same lattice-based methods that have been developed for Gaussian mixture HMMs, and that using a sequence classification criterion in training leads to considerably better performance. A neural network acoustic model with 153K weights trained on 50 hours of broadcast news has a word error rate of 34.0% on the rt04 English broadcast news test set. When this model is trained with the state-level minimum Bayes risk criterion, the rt04 word error rate is 27.7%.
BibTeX
@inproceedings{kingsbury2009lattice,
  author = {Brian Kingsbury},
  title = {{Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2009},
  url = {https://openreview.net/forum?id=ruduPbARUe5},
}

Loading related content...

Figure