Open-World Factually Consistent Question Generation

Himanshu Maheshwari, Sumit Shekhar, Apoorv Saxena, Niyati ChhayaACL 2023 · DOI

Abstract

Question Generation (QG) models, while proficient in language fluency, frequently hallucinate facts not present in the source text. This issue is exacerbated during domain shifts. We present a model-agnostic framework employing de-lexicalization and multi-generation strategies to mitigate these hallucinations. Our approach reduces entity-level factual inconsistencies by 84–100% across multiple domains, including legal and scientific texts, without compromising linguistic quality.

Introduction

The task of Question Generation (QG) involves transforming a source paragraph into relevant, answerable questions. Modern Large Language Models (LLMs) like BART and PEGASUS have advanced this field significantly but remain prone to "hallucinations"—the generation of entities or facts absent from the input context. This lack of grounding is particularly problematic in specialized domains (e.g., legal or financial) where the model's pre-trained internal knowledge may conflict with the provided text. Ensuring factual consistency is paramount for the deployment of QG in educational and information retrieval systems.

Methodology

To address factual inconsistency, we propose a two-stage, model-agnostic approach:

De-lexicalization Strategies

We replace named entities in the training data with placeholders to prevent the model from over-relying on its internal memory. Several strategies were evaluated:

  • [Name i] Token: Entities are replaced by placeholders based on their appearance order.
  • [Name i] with Push: Hallucinated entities in the target are replaced with random entities from the source text during training, penalizing ungrounded generation.
  • Rare Word Token: Entities in the target that do not appear in the source are replaced with rare words (e.g., "aster"). This "Rare Word" strategy proved most effective by forcing the model to learn syntactic structures rather than specific entity associations.

Multi-generation and Filtering

During inference, the model generates multiple candidate questions (top-5 beams). A filtering mechanism then selects the candidate with the highest factual consistency and lowest perplexity, ensuring the final output is both grounded and natural.

Performance comparison of various de-lexicalization and generation strategies on the ELI5 dataset.

Experimental Setup

Models were initially trained on the ELI5 (Explain Like I'm 5) dataset. To evaluate "Open-World" generalization, we tested the approach on five out-of-domain datasets: MS Marco (web search), Natural Questions (Google queries), SciQ (science exams), and specialized Reddit communities r/AskEconomics and r/AskLegal.

Results and Discussion

The proposed methods yielded significant improvements in factual grounding across all test domains.

Hallucination Reduction

The primary metric for inconsistency, $P_{wne}$ (percentage of questions with wrong named entities), saw a dramatic decrease of 84–100% compared to standard fine-tuning. On the ELI5 dataset, the F1 score for entity consistency improved by approximately 21%.

Stability of Linguistic Quality

Crucially, traditional metrics such as ROUGE remained stable, indicating that the gains in factual consistency did not come at the cost of fluency or relevance. The "Rare Word" strategy consistently outperformed existing baselines like "Spancopy."

Cross-domain evaluation results showing the effectiveness of the Rare Word strategy in reducing factual inconsistencies across diverse datasets.

Conclusion and Future Work

By prioritizing syntactic structure over entity memory, our de-lexicalization framework effectively eliminates hallucinations in QG models. While multi-generation introduces some computational overhead and can lead to more "cautious" (less entity-dense) questions, the gains in reliability are substantial. Future research will explore applying these techniques to other natural language generation tasks, such as automated medical reporting, where factual precision is critical.

Summary updated

BibTeX
@inproceedings{maheshwari2023open,
  author = {Himanshu Maheshwari and Sumit Shekhar and Apoorv Saxena and Niyati Chhaya},
  title = {{Open-World Factually Consistent Question Generation}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2023},
  doi = {10.18653/v1/2023.findings-acl.151},
}
Figure