A phonetic feature based lattice rescoring approach to LVCSR

Sabato Marco Siniscalchi, Torbjørn Svendsen, Chin-Hui Lee

Abstract

Large Vocabulary Continuous Speech Recognition (LVCSR) systems decode the input speech using diverse information sources, such as acoustic, lexical, and linguistic. Although most of the unreliable hypotheses are pruned during the recognition process, current state-of-the-art systems often make errors that are ldquounreasonablerdquo for human listeners. Several studies have shown that a proper integration of acoustic-phonetic information can be beneficial to reducing such errors. We have previously shown that high-accuracy phone recognition can be achieved if a bank of speech attribute detectors is used to compute a confidence score describing attribute activation levels that the current frame exhibits. In those experiments, the phone recognition system did not rely on the language model to follow their word sequence constraints, and the vocabulary was small. In this work, we extend our approach to LVCSR by introducing a second recognition step during which additional information not directly used during conventional log-likelihood based decoding is introduced. Experimental results show promising performance.
BibTeX
@inproceedings{siniscalchi2009phonetic,
  author = {Sabato Marco Siniscalchi and Torbjørn Svendsen and Chin-Hui Lee},
  title = {{A phonetic feature based lattice rescoring approach to LVCSR}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2009},
  doi = {10.1109/icassp.2009.4960471},
}

Loading related content...

Figure