Topic Modeling Ensembles

Zhiyong Shen, Ping Luo, Shengwen Yang, Xukun ShenICDM 2010 · OpenReview

Abstract

In this paper we propose a framework of topic modeling ensembles, a novel solution to combine the models learned by topic modeling over each partition of the whole corpus. It has the potentials for applications such as distributed topic modeling for large corpora, and incremental topic modeling for rapidly growing corpora. Since only the base models, not the original documents, are required in the ensemble, all these applications can be performed in a privacy preserving manner. We explore the theoretical foundation of the proposed framework, give its geometric interpretation, and implement it for both PLSA and LDA. The evaluation of the implementations over the synthetic and real-life data sets shows that the proposed framework is much more efficient than modeling the original corpus directly while achieves comparable effectiveness in terms of perplexity and classification accuracy.
BibTeX
@inproceedings{shen2010topic,
  author = {Zhiyong Shen and Ping Luo and Shengwen Yang and Xukun Shen},
  title = {{Topic Modeling Ensembles}},
  booktitle = {ICDM},
  year = {2010},
  url = {https://openreview.net/forum?id=IRhui8dUvU},
}

Loading related content...

Figure