Multistate Encoding with End-To-End Speech RNN Transducer Network
Lists
Only you see this
Abstract
Recurrent Neural Network Transducer (RNN-T) models [1] for automatic speech recognition (ASR) provide high accuracy speech recognition. Such end-to-end (E2E) models combine acoustic, pronunciation and language models (AM, PM, LM) of a conventional ASR system into a single neural network, dramatically reducing complexity and model size.In this paper, we propose a technique for incorporating contextual signals, such as intelligent assistant device state or dialog state, directly into RNN-T models. We explore different encoding methods and demonstrate that RNN-T models can effectively utilize such context. Our technique results in reduction in Word Error Rate (WER) of up to 10.4% relative on a variety of contextual recognition tasks. We also demonstrate that proper regularization can be used to model context independently for improved overall quality.
BibTeX
@inproceedings{wu2020multistate,
author = {Zelin Wu and Bo Li and Yu Zhang and Petar S. Aleksic and Tara N. Sainath},
title = {{Multistate Encoding with End-To-End Speech RNN Transducer Network}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2020},
doi = {10.1109/icassp40776.2020.9054287},
}Loading related content...