Towards Pragmatic Awareness in Question Answering: A Case Study in Maternal and Infant Health

Neha Srikanth, Rupak Sarkar, Rachel Rudinger, Jordan L. Boyd-Graber

Introduction

AI question-answering (QA) systems often suffer from "sycophancy"—the tendency to agree with a user's perspective even when it is based on a false premise. In high-stakes domains like maternal and infant health, answering only the surface-level question is insufficient and potentially harmful. For instance, if a user asks about skipping vaccines, a standard system might list vaccines without challenging the dangerous assumption that skipping them is acceptable.

This research introduces the concept of pragmatic awareness, where systems identify and address the unstated beliefs, presuppositions, or implications—collectively termed "pragmatic inferences"—behind a query. By "questioning the question," systems can provide safer and more complete information.

An example of how a pragmatic QA system addresses a false conversational implicature regarding breastfeeding while ill.

Methodology: Pragmatic Inference Augmentation

The authors developed a framework to inject pragmatic awareness into the standard Retrieve-Rerank-Read QA pipeline. The core idea is to move beyond simple keyword matching to verify the underlying assumptions of a question.

The Pragmatic Inference Augmentation pipeline compared to a standard baseline QA system.

The pipeline consists of three main stages:

  1. Inference Extraction: Identifying presuppositions (beliefs taken for granted) and implicatures (beliefs suggested by context).
  2. Augmented Retrieval and Reranking: The system retrieves evidence specifically to verify these extracted inferences. Passages are then reranked based on their ability to confirm or refute these assumptions.
  3. Pragmatic Generation: The final LLM (e.g., GPT-3.5, Mistral-7B) is prompted to explicitly address the identified assumptions in its response, ensuring the user receives a safe and helpful answer.

Data and Expert Annotation

To evaluate this approach, the researchers constructed a specialized dataset of 2,727 inferences derived from 500 questions across three sources: ROSIE (a maternal health QA system), Reddit (e.g., r/BabyBumps), and Google search logs (Natural Questions). A team of 20 health experts, including OB/GYNs and lactation consultants, annotated these questions for inferences, veracity (True, False, or Subjective), and provided supporting evidence from trusted medical sources.

Key Findings

  • The Implicature Challenge: Users holding false beliefs often present them as subtle implicatures rather than explicit presuppositions, making them harder for standard models to detect.
  • Sycophancy in LLMs: Standard models often fail to challenge false premises unless specifically prompted. GPT-3.5, for instance, missed approximately 63% of expert-identified inferences when tasked with automatic extraction.
  • Human Preference: Expert validators preferred inference-augmented answers in 75% of cases, particularly when the system corrected "highly plausible false assumptions" that the baseline ignored.

Conclusion

Explicitly identifying and addressing a user's underlying assumptions leads to safer and more helpful AI responses in sensitive domains. While current LLMs struggle with automatic inference extraction, the proposed pragmatic augmentation pipeline significantly improves the quality of health-related QA. Future work will focus on improving the tactfulness of these challenges and automating the extraction process to reduce reliance on human-written assumptions.

Summary updated

BibTeX
@inproceedings{srikanth2024towards,
  author = {Neha Srikanth and Rupak Sarkar and Rachel Rudinger and Jordan L. Boyd-Graber},
  title = {{Towards Pragmatic Awareness in Question Answering: A Case Study in Maternal and Infant Health}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2024},
  doi = {10.18653/v1/2024.naacl-long.403},
}
Figure