Using KL-divergence and multilingual information to improve ASR for under-resourced languages

David Imseng, Hervé Bourlard, Philip N. GarnerICASSP 2012 · OpenReview

Abstract

Setting out from the point of view that automatic speech recognition (ASR) ought to benefit from data in languages other than the target language, we propose a novel Kullback-Leibler (KL) divergence based method that is able to exploit multilingual information in the form of universal phoneme posterior probabilities conditioned on the acoustics. We formulate a means to train a recognizer on several different languages, and subsequently recognize speech in a target language for which only a small amount of data is available. Taking the Greek SpeechDat(II) data as an example, we show that the proposed formulation is sound, and show that it is able to out-perform a current state-of-the-art HMM/GMM system. We also use a hybrid Tandem-like system to further understand the source of the benefit.
BibTeX
@inproceedings{imseng2012using,
  author = {David Imseng and Hervé Bourlard and Philip N. Garner},
  title = {{Using KL-divergence and multilingual information to improve ASR for under-resourced languages}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2012},
  url = {https://openreview.net/forum?id=0E2elCpRpiX},
}

Loading related content...

Figure