Reddit financial image post sentiment dataset

Alexander Fottner, Yarema Okhrin, Jonathan Pfahler, Julian WustlData 2022 · DOI

TL;DR

This paper introduces a novel dataset of financial sentiment extracted from Reddit posts, combining both text and image analysis. This dataset aims to bridge the gap in understanding how visual content influences financial sentiment and forecasting, offering a unique resource for researchers in behavioral finance and machine learning.

What Problem Does This Paper Address?

The financial world is increasingly influenced by social media, where sentiment expressed in posts can impact market trends. While text-based sentiment analysis is common, the role of images in financial discussions, particularly on platforms like Reddit, has been largely unexplored. This paper addresses this gap by creating a dataset that captures sentiment from both text and images within financial subreddits, enabling a more comprehensive analysis of how visual cues and textual opinions interact to shape financial sentiment and potentially predict market movements.

Methods

The authors employed a multi-stage process to construct their dataset. Raw data was collected from financial subreddits using the Reddit and Pushshift APIs. A key innovation is the use of a fine-tuned MobileNets artificial neural network to classify images into four distinct categories: classical memes, number posts (like portfolio screenshots), text posts, and chart posts. This categorization was crucial because the diverse nature of these image types necessitated different extraction methods. Optical Character Recognition (OCR) was used to extract text from images, and custom methods were developed to derive sentiment scores from both textual and image content. The data was anonymized by hashing user IDs to protect privacy.

Datasets

The primary contribution of this paper is the introduction of the Reddit financial image post sentiment dataset. This dataset is comprised of three CSV files:

  • features.csv: Contains static sentiment features extracted from the content of posts.
  • comments.csv: Holds sentiment information extracted from comments associated with each post.
  • meta_time_series.csv: Stores time-series meta-information about the posts.

The data covers a period of over three months, with features.csv ranging from October 1st, 2021, to February 25th, 2022, and the other files having slightly different start dates within that timeframe. The dataset is available on a 20-minute basis.

Key Insights and Ideas

  • Visuals Matter in Financial Discourse: The paper highlights that images are not just decorative but carry significant sentiment information in financial discussions, a dimension often overlooked in traditional sentiment analysis.
  • Bridging Text and Image Sentiment: By integrating sentiment from both text and images, the dataset offers a more holistic view of user sentiment, which can be crucial for understanding complex financial narratives.
  • Anonymization for Privacy: The careful anonymization of user IDs ensures that the dataset can be used for research without compromising individual privacy, adhering to Reddit's data redistribution policies.
  • Categorization for Granular Analysis: The four-category image classification allows for tailored sentiment extraction methods, acknowledging that a meme's sentiment is processed differently than a stock chart's.

Key Results

The paper primarily focuses on the creation and description of the dataset itself, rather than presenting extensive quantitative results derived from its use. However, it details the structure and content of the dataset, including various sentiment scores (e.g., bear_score, bull_score, normal_sentiment_weighted), image classification (type_post_content), and meta-information. The dataset is designed to be aggregated on 20-minute, hourly, or daily bases for time-series analyses, and its features are intended for machine learning prediction tasks, such as analyzing the influence of sentiment on stock prices.

Limitations and Future Work

The authors acknowledge that the time series sequences in the dataset are relatively short, typically tracking posts for no longer than 24 hours. They also note the presence of outliers in some variables, such as realized percentage gains, which they chose not to exclude to allow researchers to handle them as they see fit. Future work could involve extending the time series, exploring more sophisticated image analysis techniques, and applying the dataset to various predictive modeling tasks in financial forecasting and behavioral finance.

Summary updated

Abstract

The dataset presented in this paper consists of sentiment information extracted from image and text data of financial subreddit posts. Members of these subreddits post about their trading behavior, express their opinions, and discuss capital market trends. Their posts contain sentiment information on financial topics as well as signaling information on trading decisions. Frequently, members post screenshots of their portfolios from their mobile broker apps. We collected the posts, processed them to extract sentiment scores using various methods, and anonymized them. The dataset consists therefore not of any content from the posts or information about the author, but the processed sentiment information within the post. Further financial tickers mentioned in the posts are tracked, such that the effect of sentiment in the posts can be attributed to financial products and used in the context of financial forecasting. The posts were collected using the Reddit [2] and Pushshift APIs [3] and processed using an Amazon Web Services architecture. A fine-tuned MobileNets artificial neural network [4] was used to classify images into four distinct categories, which had been determined in a preliminary analysis. The categories included <i>classical memes, number posts</i> (e.g. screenshots of mobile broker portfolios), <i>text posts</i> (e.g. screenshots from twitter) and <i>chart posts</i> (e.g. other financial screenshots, such as charts). The reason for the classification of images into the four categories is that the images are so inherently different, that different extraction methods had to be applied for each category. OCR - methods [5] were used to extract text from images. Custom methods were applied to extract sentiment and other information from the resulting text. The data [1] is available on a 20-minute basis and can be used in many areas, such as financial forecasting and analyzing sentiment dynamics in social media posts.
BibTeX
@inproceedings{fottner2022reddit,
  author = {Alexander Fottner and Yarema Okhrin and Jonathan Pfahler and Julian Wustl},
  title = {{Reddit financial image post sentiment dataset}},
  booktitle = {Data},
  year = {2022},
  doi = {10.1016/j.dib.2022.108759},
}
Figure