Inferring document relevance via average precision
Lists
Only you see this
Abstract
We consider the problem of evaluating retrieval systems using a limited number of relevance judgments. Recent work has demonstrated that one can accurately estimate average precision via a judged pool corresponding to a relatively small random sample of documents. In this work, we demonstrate that given values or estimates of average precision, one can accurately infer the relevances of unjudged documents. Combined, we thus show how one can efficiently and accurately infer a large judged pool from a relatively small number of judged documents, thus permitting accurate and efficient retrieval evaluation on a large scale.
BibTeX
@inproceedings{aslam2006inferring,
author = {Javed A. Aslam and Emine Yilmaz},
title = {{Inferring document relevance via average precision}},
booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
year = {2006},
url = {https://openreview.net/forum?id=rkEgxI-ubS},
}Loading related content...