Finding the Best of Both Worlds: Faster and More Robust Top-k Document Retrieval

Omar Khattab, Mohammad Hammoud, Tamer ElsayedSIGIR 2020 · OpenReview

Abstract

Many top-k document retrieval strategies have been proposed based on the WAND and MaxScore heuristics and yet, from recent work, it is surprisingly difficult to identify the "fastest" strategy. This becomes even more challenging when considering various retrieval criteria, like different ranking models and values of k. In this paper, we conduct the first extensive comparison between ten effective strategies, many of which were never compared before to our knowledge, examining their efficiency under five representative ranking models. Based on a careful analysis of the comparison, we propose LazyBM, a remarkably simple retrieval strategy that bridges the gap between the best performing WAND-based and MaxScore-based approaches. Empirically, LazyBM considerably outperforms all of the considered strategies across ranking models, values of k, and index configurations under both mean and tail query latency.
BibTeX
@inproceedings{khattab2020finding,
  author = {Omar Khattab and Mohammad Hammoud and Tamer Elsayed},
  title = {{Finding the Best of Both Worlds: Faster and More Robust Top-k Document Retrieval}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2020},
  url = {https://openreview.net/forum?id=TRuZDnPu-g},
}

Loading related content...

Figure