Aggregate and mixed-order Markov models for statistical language processing
Lists
Only you see this
Abstract
We consider the use of language models whose size and accuracy are intermediate between different order n-gram models. Two types of models are studied in particular. Aggregate Markov models are class-based bigram models in which the mapping from words to classes is probabilistic. Mixed-order Markov models combine bigram models whose predictions are conditioned on different words. Both types of models are trained by Expectation-Maximization (EM) algorithms for maximum likelihood estimation. We examine smoothing procedures in which these models are interposed between different order n-grams. This is found to significantly reduce the perplexity of unseen word combinations.
BibTeX
@inproceedings{saul1997aggregate,
author = {Lawrence K. Saul and Fernando Pereira},
title = {{Aggregate and mixed-order Markov models for statistical language processing}},
booktitle = {Conference on Empirical Methods in Natural Language Processing},
year = {1997},
url = {https://openreview.net/forum?id=B14W0-Md-r},
}Loading related content...