A Note on the Implementation of

Phil Blunsom, Sharon Goldwater, Trevor Cohn, Mark Johnson

Abstract

The implementation of collapsed Gibbs samplers for non-parametric Bayesian models is non-trivial, requiring considerable book-keeping. Goldwater et al. (2006a) presented an approximation which significantly reduces the storage and computation overhead, but we show here that their formulation was incorrect and, even after correction, is grossly inaccurate. We present an alternative formulation which is exact and can be computed easily. However this approach does not work for hierarchical models, for which case we present an efficient data structure which has a better space complexity than the naive approach.
BibTeX
@inproceedings{blunsom2009note,
  author = {Phil Blunsom and Sharon Goldwater and Trevor Cohn and Mark Johnson},
  title = {{A Note on the Implementation of}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2009},
  url = {https://openreview.net/forum?id=SJNP9sldZH},
}

Loading related content...

Figure