Speech Recognition System Combination for Machine Translation

Mark J. F. Gales, Xunying Liu, Rohit Sinha, Philip C. Woodland, Kai Yu, Spyros Matsoukas, Tim Ng, Kham Nguyen, Long Nguyen, Jean-Luc Gauvain, Lori Lamel, Abdelkhalek Messaoudi

Abstract

The majority of state-of-the-art speech recognition systems make use of system combination. The combination approaches adopted have traditionally been tuned to minimising Word Error Rates (WERs). In recent years there has been growing interest in taking the output from speech recognition systems in one language and translating it into another. This paper investigates the use of cross-site combination approaches in terms of both WER and impact on translation performance. In addition the stages involved in modifying the output from a Speech-to-Text (STT) system to be suitable for translation are described. Two source languages, Mandarin and Arabic, are recognised and then translated using a phrase-based statistical machine translation system into English. Performance of individual systems and cross-site combination using cross-adaptation and ROVER are given. Results show that the best STT combination scheme in terms of WER is not necessarily the most appropriate when translating speech.
BibTeX
@inproceedings{gales2007speech,
  author = {Mark J. F. Gales and Xunying Liu and Rohit Sinha and Philip C. Woodland and Kai Yu and Spyros Matsoukas and Tim Ng and Kham Nguyen and Long Nguyen and Jean-Luc Gauvain and Lori Lamel and Abdelkhalek Messaoudi},
  title = {{Speech Recognition System Combination for Machine Translation}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2007},
  doi = {10.1109/icassp.2007.367310},
}

Loading related content...

Figure