Automatic disfluency removal for improving spoken language translation

Wen Wang, Gökhan Tür, Jing Zheng, Necip Fazil Ayan

Abstract

Statistical machine translation (SMT) systems for spoken languages suffer from conversational speech phenomena, in particular, the presence of speech disfluencies. We examine the impact of disfluencies from broadcast conversation data on our hierarchical phrase-based SMT system and implement automatic disfluency removal approaches for cleansing the MT input. We evaluate the efficacy of proposed approaches and investigate the impact of disfluency removal on SMT performance across different disfluency types. We show that for translating Mandarin broadcast conversational transcripts into English, our automatic disfluency removal approaches could produce significant improvement in BLEU and TER.
BibTeX
@inproceedings{wang2010automatic,
  author = {Wen Wang and Gökhan Tür and Jing Zheng and Necip Fazil Ayan},
  title = {{Automatic disfluency removal for improving spoken language translation}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2010},
  doi = {10.1109/icassp.2010.5494999},
}

Loading related content...

Figure