Retrieving false claims on Twitter during the Russia-Ukraine conflict

Valerio La Gatta, Chiyu Wei, Luca Luceri, Francesco Pierri, Emilio FerraraarXiv 2023 · DOI · arXiv

TL;DR

Researchers have developed a two-step transformer-based pipeline to automatically detect and retrieve verified false claims spreading on Twitter during the initial weeks of the Russia-Ukraine conflict. By combining binary classification with sophisticated information retrieval, the framework demonstrates how social media platforms can bridge the gap between manual fact-checking and large-scale moderation.

What Problem Does This Paper Address?

Major geopolitical events, such as the 2022 Russian invasion of Ukraine, are often accompanied by massive waves of online disinformation. While fact-checking organizations like Snopes and PolitiFact work tirelessly to verify or debunk stories, the sheer volume of social media content makes manual moderation impossible.

The challenge lies in the "last mile" of fact-checking: once a claim is verified as false, how do we efficiently find the thousands of individual posts spreading that specific claim? This paper addresses the need for an automated pipeline that can (1) identify if a tweet contains a known false claim and (2) accurately link that tweet to the specific verified debunking report.

Methods

The authors propose a sequential two-step methodological framework:

  1. Claim Detection: This is framed as a binary classification task. The authors fine-tuned a BERT-base-cased model to determine if an input tweet contains any of the false claims in their database. To handle the fact that most tweets do not contain these specific claims (class imbalance), they employed random oversampling of the minority "positive" class.
  2. Claim Retrieval: If a claim is detected, this second model ranks the database of verified claims to find the most relevant match. They utilized a RoBERTa-based cross-encoder (specifically stsb-roberta-base), which is optimized for semantic textual similarity.
Figure 2: Our proposed methodological framework: the claim detection model detects whether the input tweet re- ports a fact-checked (false) claim. If a claim is detected, the claim retrieval model retrieves the most relevant claims (within the corpus of “Verified Claims”) related to the tweet.

Datasets

The study utilizes a specialized dataset focused on the dawn of the conflict:

  • Verified Claims: 83 English false claims verified between February 22 and March 1, 2022, sourced from the Russia-Ukraine Conflict-Misinfo Dashboard.
  • Twitter Data: Over 2 million English tweets collected via conflict-related keywords during the same period.
  • Manual Annotations: The authors created a high-quality benchmark by manually annotating 5,872 unique tweets. They used RoBERTa embeddings to find the top 100 most similar tweets for each claim to make the manual labeling process more efficient.
Figure 1: Distribution of the number of tweets with respect to the number of claims

Key Insights and Ideas

  • Generalization to the "Unseen": A critical part of the study was the Leave Claim Out (LCO) assessment. The models were tested on claims they had never seen during training. The results showed that the system generalizes well, which is essential for real-world scenarios where new false narratives emerge daily.
  • The Power of Oversampling: The researchers found that simply replicating the minority class (tweets containing claims) during training significantly boosted the predictive power of the detection model across all metrics.
  • Mention vs. Stance: The framework identifies tweets that discuss a claim, regardless of whether the user supports or refutes it. While this is useful for tracking the spread of a narrative, it highlights that detection is not the same as sentiment analysis.

Key Results

  • Detection Performance: The BERT-based model achieved an accuracy of 81.59% and an F1-score of 80.57%, significantly outperforming standard TF-IDF baselines.
  • Retrieval Accuracy: The retrieval model was highly effective, achieving a HitRatio@1 of 86.05% in standard settings and 82.25% for unseen claims. This means the correct verified claim was the top-ranked result more than 80% of the time.
  • "In the Wild" Testing: When applied to unannotated data, the retrieval model remained robust, correctly matching 34 out of 36 tweets that were manually verified to contain claims. However, the detection model showed a tendency to overestimate the number of tweets containing false claims (high false-positive rate).
Table 2: Claim detection: performance with and without ran- dom oversampling

Limitations and Future Work

The authors acknowledge several areas for improvement:

  • Temporal Constraints: The study only looked at the first week of the invasion. Misinformation evolves, and what is considered "false" can change as new evidence emerges.
  • Stance Detection: The current model does not distinguish between a user spreading a lie and a user debunking it. Future iterations could integrate stance detection to provide better context for moderators.
  • Multimodal Content: The current framework is text-only. Since misinformation often spreads through memes, edited images, and videos, extending the analysis to multimodal data is a high priority for future research.

Summary updated

Abstract

Nowadays, false and unverified information on social media sway individuals' perceptions during major geo-political events and threaten the quality of the whole digital information ecosystem. Since the Russian invasion of Ukraine, several fact-checking organizations have been actively involved in verifying stories related to the conflict that circulated online. In this paper, we leverage a public repository of fact-checked claims to build a methodological framework for automatically identifying false and unsubstantiated claims spreading on Twitter in February 2022. Our framework consists of two sequential models: First, the claim detection model identifies whether tweets incorporate a (false) claim among those considered in our collection. Then, the claim retrieval model matches the tweets with fact-checked information by ranking verified claims according to their relevance with the input tweet. Both models are based on pre-trained language models and fine-tuned to perform a text classification task and an information retrieval task, respectively. In particular, to validate the effectiveness of our methodology, we consider 83 verified false claims that spread on Twitter during the first week of the invasion, and manually annotate 5,872 tweets according to the claim(s) they report. Our experiments show that our proposed methodology outperforms standard baselines for both claim detection and claim retrieval. Overall, our results highlight how social media providers could effectively leverage semi-automated approaches to identify, track, and eventually moderate false information that spreads on their platforms.
BibTeX
@misc{gatta2023retrieving,
  author = {Valerio La Gatta and Chiyu Wei and Luca Luceri and Francesco Pierri and Emilio Ferrara},
  title = {{Retrieving false claims on Twitter during the Russia-Ukraine conflict}},
  year = {2023},
  eprint = {2303.10121},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2303.10121},
}
Figure