A Simple Approach to Jointly Rank Passages and Select Relevant Sentences in the OBQA Context
Lists
Only you see this
Abstract
In the open book question answering (OBQA) task, selecting the relevant passages and sentences from distracting information is crucial to reason the answer to a question. HotpotQA dataset is designed to teach and evaluate systems to do both passage ranking and sentence selection. Many existing frameworks use separate models to select relevant passages and sentences respectively. Such systems not only have high complexity in terms of the parameters of models but also fail to take the advantage of training these two tasks together since one task can be beneficial for the other one. In this work, we present a simple yet effective framework to address these limitations by jointly ranking passages and selecting sentences. Furthermore, we propose consistency and similarity constraints to promote the correlation and interaction between passage ranking and sentence selection. The experiments demonstrate that our framework can achieve competitive results with previous systems and outperform the baseline by 28% in terms of exact matching of relevant sentences on the HotpotQA dataset.
BibTeX
@inproceedings{luo2022simple,
author = {Man Luo and Shuguang Chen and Chitta Baral},
title = {{A Simple Approach to Jointly Rank Passages and Select Relevant Sentences in the OBQA Context}},
booktitle = {Student Research Workshop @ NAACL},
year = {2022},
doi = {10.18653/v1/2022.naacl-srw.23},
}| You Only Need One Model for Open-domain Question Answering | EMNLP · 2022 |
| 1-PAGER: One Pass Answer Generation and Evidence Retrieval | EMNLP · 2023 |
| Ranking and Sampling in Open-Domain Question Answering | EMNLP · 2019 |
| Joint Training of Candidate Extraction and Answer Selection for Reading Comprehension | arXiv · 2018 |
| Training a Ranking Function for Open-Domain Question Answering | Student Research Workshop @ NAACL · 2018 |
| Two-Step Question Retrieval for Open-Domain QA | arXiv · 2022 |