Discriminative map for acoustic model adaptation

Daniel Povey, Philip C. Woodland, Mark J. F. Gales

Abstract

In this paper we show how a discriminative objective function such as Maximum Mutual Information (MMI) can be combined with a prior distribution over the HMM parameters to give a discriminative Maximum A Posteriori (MAP) estimate for HMM training. The prior distribution can be based around the Maximum Likelihood (ML) parameter estimates, leading to a technique previously referred to as I-smoothing; or for adaptation it can be based around a MAP estimate of the ML parameters, leading to what we call MMI-MAP. This latter approach is shown to be effective for task adaptation, where data from one task (Voicemail) is used to adapt a HMM set trained on another task (Switchboard). It is shown that MMI-MAP results in a 2.1% absolute reduction in word error rate relative to standard ML-MAP with 30 hours of Voicemail task adaptation data starting from a MMI-trained Switchboard system.
BibTeX
@inproceedings{povey2003discriminative,
  author = {Daniel Povey and Philip C. Woodland and Mark J. F. Gales},
  title = {{Discriminative map for acoustic model adaptation}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2003},
  doi = {10.1109/icassp.2003.1198780},
}

Loading related content...

Figure