Probabilistic combination of text classifiers using reliability indicators: models and results

Paul N. Bennett, Susan T. Dumais, Eric Horvitz

Abstract

The intuition that different text classifiers behave in qualitatively different ways has long motivated attempts to build a better metaclassifier via some combination of classifiers. We introduce a probabilistic method for combining classifiers that considers the context-sensitive reliabilities of contributing classifiers. The method harnesses reliability indicators---variables that provide a valuable signal about the performance of classifiers in different situations. We provide background, present procedures for building metaclassifiers that take into consideration both reliability indicators and classifier outputs, and review a set of comparative studies undertaken to evaluate the methodology.
BibTeX
@inproceedings{bennett2002probabilistic,
  author = {Paul N. Bennett and Susan T. Dumais and Eric Horvitz},
  title = {{Probabilistic combination of text classifiers using reliability indicators: models and results}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2002},
  doi = {10.1145/564376.564413},
}

Loading related content...

Figure