Topic Quality Metrics Based on Distributed Word Representations

Sergey I. Nikolenko

Abstract

Automated evaluation of topic quality remains an important unsolved problem in topic modeling and represents a major obstacle for development and evaluation of new topic models. Previous attempts at the problem have been formulated as variations on the coherence and/or mutual information of top words in a topic. In this work, we propose several new metrics for evaluating topic quality with the help of distributed word representations; our experiments suggest that the new metrics are a better match for human judgement, which is the gold standard in this case, than previously developed approaches.
BibTeX
@inproceedings{nikolenko2016topic,
  author = {Sergey I. Nikolenko},
  title = {{Topic Quality Metrics Based on Distributed Word Representations}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2016},
  doi = {10.1145/2911451.2914720},
}

Loading related content...

Figure