ACORDAR: A Test Collection for Ad Hoc Content-Based (RDF) Dataset Retrieval
Lists
Only you see this
Abstract
Ad hoc dataset retrieval is a trending topic in IR research. Methods and systems are evolving from metadata-based to content-based ones which exploit the data itself for improving retrieval accuracy but thus far lack a specialized test collection. In this paper, we build and release the first test collection for ad hoc content-based dataset retrieval, where content-oriented dataset queries and content-based relevance judgments are annotated by human experts who are assisted with a dashboard designed specifically for comprehensively and conveniently browsing both the metadata and data of a dataset. We conduct extensive experiments on the test collection to analyze its difficulty and provide insights into the underlying task.
BibTeX
@inproceedings{lin2022acordar,
author = {Tengteng Lin and Qiaosheng Chen and Gong Cheng and Ahmet Soylu and Basil Ell and Ruoqi Zhao and Qing Shi and Xiaxia Wang and Yu Gu and Evgeny Kharlamov},
title = {{ACORDAR: A Test Collection for Ad Hoc Content-Based (RDF) Dataset Retrieval}},
booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
year = {2022},
doi = {10.1145/3477495.3531729},
}Loading related content...