r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detection

Kai Nakamura, Sharon Levy, William Yang WangarXiv 2019 · OpenReview

TL;DR

This paper introduces Fakeddit, a massive, multimodal dataset for fake news detection, featuring over a million samples with text, images, and fine-grained labels. They demonstrate that combining text and image information significantly improves fake news detection accuracy, highlighting the importance of multimodal approaches for robust systems.

What Problem Does This Paper Address?

The proliferation of fake news poses a significant threat to society, impacting everything from public discourse to individual trust. While machine learning offers a promising avenue for combating this, the field has been hampered by a lack of comprehensive and diverse datasets. Existing datasets often suffer from limited size, a lack of multimodal data (text and images), and insufficient granularity in their classification schemes, making it difficult to develop robust and generalizable fake news detection models. This paper aims to bridge this gap by introducing a large-scale, multimodal dataset with fine-grained categorization.

Methods

The core of this work is the creation and utilization of the Fakeddit dataset. The authors employed a multi-stage data collection and cleaning process, sourcing data from 22 diverse Reddit subreddits. They utilized "distant supervision," where subreddit themes were used to assign labels, followed by rigorous quality assurance steps, including manual sampling and filtering based on user scores.

For fake news detection, they explored various machine learning approaches:

  • Text Feature Extraction: They used InferSent and BERT to generate embeddings for submission titles.
  • Image Feature Extraction: They employed established convolutional neural network architectures like VGG16, EfficientNet, and ResNet50 to extract image features.
  • Multimodal Fusion: They experimented with combining text and image features using four methods: addition, concatenation, maximum, and average. These fused features were then fed into a softmax classifier.

Datasets

The primary contribution is the Fakeddit dataset, which comprises:

  • Over 1 million samples: Significantly larger than many existing datasets.
  • Multimodal: Includes both text (submission titles) and images (thumbnails).
  • Fine-grained Labels: Offers 2-way (true/fake), 3-way (true, fake with true text, fake with false text), and 6-way classification (True, Satire/Parody, Misleading Content, Imposter Content, False Connection, Manipulated Content).
  • Source: Collected from 22 diverse subreddits on Reddit.
  • Metadata: Includes comments, scores, author usernames, subreddit sources, and domains.

They also reference and compare their work against existing datasets like FEVER, LIAR, and FakeNewsCorpus, highlighting Fakeddit's advantages in scale, multimodality, and label diversity.

Key Insights and Ideas

  • The Power of Multimodality: The results strongly suggest that combining text and image information is crucial for effective fake news detection. Models leveraging both modalities consistently outperformed text-only or image-only approaches.
  • Fine-grained Classification Matters: Moving beyond a simple binary true/false classification to a 6-way system reveals nuances in fake news and allows for more targeted detection strategies.
  • Dataset Scale and Diversity are Key: The sheer size and variety of subreddits in Fakeddit contribute to its robustness, enabling models to learn from a wider range of linguistic styles and content types.
  • Imposter Content and Satire are Challenging: The error analysis indicates that models struggle most with identifying "Imposter Content" (likely bot-generated) and "Satire/Parody," suggesting these are complex areas requiring further research.

Key Results

  • Multimodal models achieved the highest accuracy across all classification levels (2-way, 3-way, and 6-way).
  • The BERT + ResNet50 combination using the "maximum" fusion method yielded the best overall performance, achieving approximately 89% accuracy for 2-way classification and 86% for 6-way classification on the test set.
  • Multimodal features consistently outperformed text-only and image-only features.
  • The dataset analysis revealed that Fakeddit has a broader diversity of text lengths and higher lexical variety compared to datasets like FEVER.

Limitations and Future Work

  • Distant Supervision Noise: The authors acknowledge that using subreddit themes for labeling (distant supervision) can introduce noise into the dataset. While they implemented quality assurance steps, some misclassifications may still exist.
  • Limited Manual Labeling: The dataset relies on distant supervision rather than extensive manual labeling for all samples, which could be a limitation for highly nuanced categories.
  • Underutilization of Metadata: The current work primarily focuses on text and image. The authors suggest that future research could leverage submission metadata and user comments for richer analysis.
  • Future Directions: The paper points towards future work in incorporating video data, exploring user credibility through metadata, and developing implicit fact-checking capabilities using the dataset's multimodal nature. They also suggest future work could aim to identify multiple labels for each text-image pair.

Summary updated

Abstract

Fake news has altered society in negative ways in politics and culture. It has adversely affected both online social network systems as well as offline communities and conversations. Using automatic machine learning classification models is an efficient way to combat the widespread dissemination of fake news. However, a lack of effective, comprehensive datasets has been a problem for fake news research and detection model development. Prior fake news datasets do not provide multimodal text and image data, metadata, comment data, and fine-grained fake news categorization at the scale and breadth of our dataset. We present Fakeddit, a novel multimodal dataset consisting of over 1 million samples from multiple categories of fake news. After being processed through several stages of review, the samples are labeled according to 2-way, 3-way, and 6-way classification categories through distant supervision. We construct hybrid text+image models and perform extensive experiments for multiple variations of classification, demonstrating the importance of the novel aspect of multimodality and fine-grained classification unique to Fakeddit.
BibTeX
@misc{nakamura2019r,
  author = {Kai Nakamura and Sharon Levy and William Yang Wang},
  title = {{r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detection}},
  year = {2019},
  eprint = {1911.03854},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1911.03854},
}
Figure