Speech Recognition Engineering Issues in Speech to Speech Translation System Design for Low Resource Languages and Domains
Lists
Only you see this
Abstract
Engineering automatic speech recognition (ASR) for speech to speech (S2S) translation systems, especially targeting languages and domains that do not have readily available spoken language resources, is immensely challenging due to a number of reasons. In addition to contending with the conventional data-hungry speech acoustic and language modeling needs, these designs have to accommodate varying requirements imposed by the domain needs and characteristics, target device and usage modality (such as phrase-based, or spontaneous free form interactions, with or without visual feedback) and huge spoken language variability arising due to socio-linguistic and cultural differences of the users. This paper, using case studies of creating speech translation systems between English and languages such as Pashto and Farsi, describes some of the practical issues and the solutions that were developed for multilingual ASR development. These include novel acoustic and language modeling strategies such as language adaptive recognition, active-learning based language modeling, class-based language models that can better exploit resource poor language data, efficient search strategies, including N-best and confidence generation to aid multiple hypotheses translation, use of dialog information and clever interface choices to facilitate ASR, and audio interface design for meeting both usability and robustness requirements
BibTeX
@inproceedings{narayanan2006speech,
author = {Shrikanth S. Narayanan and Panayiotis G. Georgiou and Abhinav Sethy and Dagen Wang and Murtaza Bulut and Shiva Sundaram and Emil Ettelaie and Sankaranarayanan Ananthakrishnan and Horacio Franco and Kristin Precoda and Dimitra Vergyri and Jing Zheng and Wen Wang and Venkata Ramana Rao Gadde and Martin Graciarena and Victor Abrash and Michael W. Frandsen and Colleen Richey},
title = {{Speech Recognition Engineering Issues in Speech to Speech Translation System Design for Low Resource Languages and Domains}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2006},
url = {https://openreview.net/forum?id=m4971C5exAo},
}Loading related content...