"Why is this misleading?": Detecting News Headline Hallucinations with Explanations

Jiaming Shen, Jialu Liu, Daniel Finnie, Negar Rahmati, Michael Bendersky, Marc Najork

TL;DR

Researchers at Google have developed ExHalder, a framework that not only detects when an AI-generated news headline is "hallucinated" (i.e., not supported by the source article) but also provides a natural language explanation for its decision. By adapting knowledge from large-scale Natural Language Inference (NLI) datasets, ExHalder achieves state-of-the-art performance in identifying misleading headlines, even in zero-shot settings where no domain-specific training data is available.

What Problem Does This Paper Address?

While abstractive summarization models have become adept at generating concise news headlines, they frequently suffer from the hallucination issue: generating text that is fluent but factually unsupported by the source article. For example, a model might summarize an article about "moving lectures online" as "stopping online lectures"—a complete reversal of meaning.

Detecting these errors is exceptionally difficult because:

  1. Infrequent occurrence: Hallucinations are relatively rare, making it hard to find enough examples for standard supervised learning.
  2. High cognitive load: Human raters must read articles carefully to reach a consensus, making high-quality data collection expensive and slow.
  3. Lack of transparency: Existing detectors often provide only a binary "supported/unsupported" label, leaving users and developers wondering why a headline was flagged as misleading.

Methods

ExHalder (Explanation-enhanced Headline Hallucination detector) is built on an encoder-decoder architecture (specifically T5-11B) and employs a multi-component strategy to bridge the gap between classification and explanation.

The framework consists of three key modules:

  • Reasoning Classifier: Takes an (article, headline) pair and outputs both a class label (Entail/Contradict) and a natural language explanation.
  • Hinted Classifier: A refined predictor that takes the (article, headline, explanation) triplet as input. The explanation acts as a "hint" to improve classification accuracy.
  • Explainer: A generative module that takes the (article, headline, class) and focuses solely on producing a high-quality rationale.
Figure 2: Key Components of ExHalder framework.

To overcome data scarcity, the authors use two novel training techniques:

  1. NLI-based Pretraining: The model is first trained on massive Natural Language Inference datasets (like eSNLI and ANLI). The authors argue that the NLI task (determining if a premise entails a hypothesis) is semantically nearly identical to the headline hallucination task.
  2. Explainer-augmented Training: The trained Explainer is used to generate multiple synthetic explanations for each training example. This data augmentation helps the classifiers handle the high variability of natural language rationales.

Datasets

The study utilizes a mix of new and established benchmarks:

  • New News Headline Dataset: The authors curated 6,270 (article, headline) pairs. Headlines were generated by a state-of-the-art model (NHNet), and labels were provided by journalism experts. Crucially, 2,074 examples include human-written explanations.
  • TRUE Benchmark: To test generalization, the model was evaluated on six public datasets for hallucination detection and fact verification, including MNBM, FRANK, QAGS, SummEval, FEVER, and Vitamin-C.

Key Insights and Ideas

  • Explanations as Learning Signals: Natural language explanations are more than just a user-facing feature; they serve as a rich supervisory signal that helps the model capture subtle semantic discrepancies that a binary label would miss.
  • Domain Transferability: The "logic" of entailment learned from general-domain NLI datasets transfers remarkably well to the specific nuances of news reporting.
  • The Power of "Hints": By feeding its own generated explanations back into a "hinted" classifier, the model can effectively double-check its reasoning, leading to more robust final predictions.

Key Results

ExHalder demonstrates significant improvements over traditional baselines (SVM, XGBoost) and standard pretrained models (BERT, T5):

  • Supervised Performance: On the new news dataset, ExHalder achieved an F1 score of 74.08, significantly outperforming a standard T5 model (71.29) and a T5 model with simple explanation output (70.63).
  • Zero-Shot Superiority: Without any in-domain training, ExHalder set new state-of-the-art results on all six datasets in the TRUE benchmark, achieving an average accuracy of 82.91%.
  • Qualitative Utility: Case studies show the model successfully identifying complex errors, such as conflicting dates (e.g., "2021 vs 2019") or missing context that changes the headline's meaning.
Figure 1: An illustrative example of automated news head- line hallucination detection with a model generated natural language explanation.

Limitations and Future Work

The authors identify several areas for improvement:

  • Temporal Reasoning: The model occasionally fails to recognize synonyms for dates (e.g., not realizing "March end" and "March 31" refer to the same time), leading to false positives.
  • Multi-document Scope: The current framework is designed for single-article headlines. Extending this to headlines generated from a cluster of related news stories is a significant future challenge.
  • Explanation Faithfulness: While the explanations are human-readable, ensuring they are always perfectly faithful to the source text (and not themselves hallucinated) remains an active research goal.

Summary updated

Abstract

Automatic headline generation enables users to comprehend ongoing news events promptly and has recently become an important task in web mining and natural language processing. With the growing need for news headline generation, we argue that the hallucination issue, namely the generated headlines being not supported by the original news stories, is a critical challenge for the deployment of this feature in web-scale systems Meanwhile, due to the infrequency of hallucination cases and the requirement of careful reading for raters to reach the correct consensus, it is difficult to acquire a large dataset for training a model to detect such hallucinations through human curation. In this work, we present a new framework named ExHalder to address this challenge for headline hallucination detection. ExHalder adapts the knowledge from public natural language inference datasets into the news domain and learns to generate natural language sentences to explain the hallucination detection results. To evaluate the model performance, we carefully collect a dataset with more than six thousand labeled <article, headline> pairs. Extensive experiments on this dataset and another six public ones demonstrate that ExHalder can identify hallucinated headlines accurately and justifies its predictions with human-readable natural language explanations.
BibTeX
@inproceedings{shen2023why,
  author = {Jiaming Shen and Jialu Liu and Daniel Finnie and Negar Rahmati and Michael Bendersky and Marc Najork},
  title = {{"Why is this misleading?": Detecting News Headline Hallucinations with Explanations}},
  booktitle = {The Web Conference},
  year = {2023},
  url = {https://openreview.net/forum?id=MXzolfQOf8},
}
Figure