Context-Aware Term Weighting For First Stage Passage Retrieval

Zhuyun Dai, Jamie CallanSIGIR 2020 · OpenReview

Abstract

Term frequency is a common method for identifying the importance of a term in a document. But term frequency ignores how a term interacts with its text context, which is key to estimating document-specific term weights. This paper proposes a Deep Contextualized Term Weighting framework (DeepCT) that maps the contextualized term representations from BERT to into context-aware term weights for passage retrieval. The new, deep term weights can be stored in an ordinary inverted index for efficient retrieval. Experiments on two datasets demonstrate that DeepCT greatly improves the accuracy of first-stage passage retrieval algorithms.
BibTeX
@inproceedings{dai2020context,
  author = {Zhuyun Dai and Jamie Callan},
  title = {{Context-Aware Term Weighting For First Stage Passage Retrieval}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2020},
  url = {https://openreview.net/forum?id=18f1J5ujxbM},
}

Loading related content...

Figure