Counting Lumps in Word Space: Density as a Measure of Corpus Homogeneity

Magnus Sahlgren, Jussi Karlgren

Abstract

This paper introduces a measure of corpus homogeneity that indicates the amount of topical dispersion in a corpus. The measure is based on the density of neighborhoods in semantic word spaces. We evaluate the measure by comparing the results for five different corpora. Our initial results indicate that the proposed density measure can indeed identify differences in topical dispersion.
BibTeX
@inproceedings{sahlgren2005counting,
  author = {Magnus Sahlgren and Jussi Karlgren},
  title = {{Counting Lumps in Word Space: Density as a Measure of Corpus Homogeneity}},
  booktitle = {SPIRE},
  year = {2005},
  doi = {10.1007/11575832\_16},
}

Loading related content...

Figure