Learning from Fact-checkers: Analysis and Generation of Fact-checking Language

Nguyen Vo, Kyumin Lee

TL;DR

While automatic fake news detection has improved, misinformation often persists even after being debunked. This paper shifts the focus from detection to intervention by analyzing how human "fact-checkers" engage on Twitter and proposing a deep learning framework, the Fact-checking Response Generator (FCRG), to automatically generate high-quality, persuasive responses that refute false claims.

What Problem Does This Paper Address?

The authors identify a critical gap in the fight against misinformation: detection is not enough. Even when news is flagged as fake, users continue to share it due to confirmation bias and the "echo chamber" effect.

The most effective countermeasure is often direct engagement from other users—"fact-checkers"—who reply to false tweets with evidence and links to reputable sites like Snopes or PolitiFact. However, manually crafting these responses is time-consuming. The authors aim to understand the linguistic "DNA" of successful fact-checking and build a tool that helps these volunteers scale their impact by generating relevant, formal, and evidence-based replies.

Methods

The research follows a two-step approach:

  1. Linguistic Analysis: The authors used LIWC (Linguistic Inquiry and Word Count) and SEMAFOR (for semantic frame parsing) to compare fact-checking tweets (FC-tweets) against "Normal Replies" and "Random Replies." They looked at psycholinguistic traits, lexical usage, and semantic structures.
  2. The FCRG Framework: They built a neural text generation model based on a Seq2Seq (Sequence-to-Sequence) architecture with a Gated Recurrent Unit (GRU).
  3. Encoder: Captures the context of the original misinformation tweet.
  4. Decoder: Generates the response.
  5. Attention Mechanisms: They tested two types of attention—Dot Attention (FCRG-DT) and Bilinear Attention (FCRG-BL)—to help the model focus on specific parts of the original tweet (like keywords or claims) when generating the reply.
  6. Shared Embeddings: Unlike standard models that use separate embeddings, they used a shared word embedding layer to reduce parameters and prevent overfitting in a domain with specific jargon.

Datasets

The authors curated a substantial new dataset for this task:

  • FC-Tweet Dataset: 64,110 original tweets and 73,203 associated fact-checking replies. These were collected using the Hoaxy system and filtered to ensure the cited articles were explicitly rated as "True" or "False" by professional fact-checkers.
  • Comparison Sets: 73,203 "Normal Replies" (direct replies without URLs) and 73,203 "Random Replies" to serve as baselines for linguistic analysis.

Key Insights and Ideas

  • The Fact-Checker’s Persona: Fact-checkers aren't just "angry internet users." The analysis shows they use significantly more formal language, fewer swear words, and less internet slang than average repliers. They tend to use impersonal pronouns ("this," "it") to focus on the claim rather than the person.
  • Temporal Focus: Fact-checkers focus on the past (using past-tense verbs to refer to debunked stories), whereas normal replies focus on the present or future.
  • Semantic Frames: FC-tweets heavily utilize frames like Artificiality (words like "fake," "false," "lie") and Statement ("reports," "claims," "said").
  • The "Goldilocks" Length: The study found that FC-tweets between 10 and 20 tokens received the most engagement (shares/retweets). Very short replies aren't informative enough, and very long ones are likely ignored.

Key Results

The FCRG models were evaluated against state-of-the-art baselines like SeqAttB and HRED:

  • Quantitative: FCRG-DT and FCRG-BL outperformed baselines across almost all metrics. In scenarios requiring at least 10 tokens, FCRG-DT showed a 17.9% improvement in BLEU-3 and a 13% improvement in BLEU-4 over the best baseline.
  • Qualitative (Human Evaluation): In a blind test, human evaluators preferred the responses generated by FCRG-DT 40% of the time, compared to 28% for SeqAttB and 36% for HRED. The model was praised for capturing specific entities (like "uranium" or "Snopes") from the context.
  • Impact: The authors observed that after receiving an FC-tweet, 7% of original misinformation tweets were eventually deleted or hidden, suggesting that these interventions have a measurable "chilling effect" on fake news.

Limitations and Future Work

  • URL Selection: Currently, the model assumes the user provides the fact-checking URL. A fully automated system would need to retrieve the correct debunking article from a database based on the tweet's content.
  • Rare Words: Like many word-based RNNs, the model struggles with "out-of-vocabulary" or rare words. The authors suggest moving to character-level RNNs in the future.
  • Article Content: The current model doesn't "read" the content of the fact-checking article; it only learns from how humans have written about it. Incorporating the actual evidence from the linked articles could make the generated responses even more persuasive.

Summary updated

Abstract

In fighting against fake news, many fact-checking systems comprised of human-based fact-checking sites (e.g., snopes.com and politifact.com) and automatic detection systems have been developed in recent years. However, online users still keep sharing fake news even when it has been debunked. It means that early fake news detection may be insufficient and we need another complementary approach to mitigate the spread of misinformation. In this paper, we introduce a novel application of text generation for combating fake news. In particular, we (1) leverage online users named fact-checkers, who cite fact-checking sites as credible evidences to fact-check information in public discourse; (2) analyze linguistic characteristics of fact-checking tweets; and (3) propose and build a deep learning framework to generate responses with fact-checking intention to increase the fact-checkers' engagement in fact-checking activities. Our analysis reveals that the fact-checkers tend to refute misinformation and use formal language (e.g. few swear words and Internet slangs). Our framework successfully generates relevant responses, and outperforms competing models by achieving up to 30% improvements. Our qualitative study also confirms that the superiority of our generated responses compared with responses generated from the existing models.
BibTeX
@inproceedings{vo2019learning,
  author = {Nguyen Vo and Kyumin Lee},
  title = {{Learning from Fact-checkers: Analysis and Generation of Fact-checking Language}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2019},
  url = {https://openreview.net/forum?id=kKzq2R8812},
}

Loading related content...

Figure