TL;DR
This paper introduces a novel dataset of financial sentiment extracted from Reddit posts, combining both text and image analysis. This dataset aims to bridge the gap in understanding how visual content influences financial sentiment and forecasting, offering a unique resource for researchers in behavioral finance and machine learning.
What Problem Does This Paper Address?
The financial world is increasingly influenced by social media, where sentiment expressed in posts can impact market trends. While text-based sentiment analysis is common, the role of images in financial discussions, particularly on platforms like Reddit, has been largely unexplored. This paper addresses this gap by creating a dataset that captures sentiment from both text and images within financial subreddits, enabling a more comprehensive analysis of how visual cues and textual opinions interact to shape financial sentiment and potentially predict market movements.
Methods
The authors employed a multi-stage process to construct their dataset. Raw data was collected from financial subreddits using the Reddit and Pushshift APIs. A key innovation is the use of a fine-tuned MobileNets artificial neural network to classify images into four distinct categories: classical memes, number posts (like portfolio screenshots), text posts, and chart posts. This categorization was crucial because the diverse nature of these image types necessitated different extraction methods. Optical Character Recognition (OCR) was used to extract text from images, and custom methods were developed to derive sentiment scores from both textual and image content. The data was anonymized by hashing user IDs to protect privacy.
Datasets
The primary contribution of this paper is the introduction of the Reddit financial image post sentiment dataset. This dataset is comprised of three CSV files:
features.csv: Contains static sentiment features extracted from the content of posts.comments.csv: Holds sentiment information extracted from comments associated with each post.meta_time_series.csv: Stores time-series meta-information about the posts.
The data covers a period of over three months, with features.csv ranging from October 1st, 2021, to February 25th, 2022, and the other files having slightly different start dates within that timeframe. The dataset is available on a 20-minute basis.
Key Insights and Ideas
- Visuals Matter in Financial Discourse: The paper highlights that images are not just decorative but carry significant sentiment information in financial discussions, a dimension often overlooked in traditional sentiment analysis.
- Bridging Text and Image Sentiment: By integrating sentiment from both text and images, the dataset offers a more holistic view of user sentiment, which can be crucial for understanding complex financial narratives.
- Anonymization for Privacy: The careful anonymization of user IDs ensures that the dataset can be used for research without compromising individual privacy, adhering to Reddit's data redistribution policies.
- Categorization for Granular Analysis: The four-category image classification allows for tailored sentiment extraction methods, acknowledging that a meme's sentiment is processed differently than a stock chart's.
Key Results
The paper primarily focuses on the creation and description of the dataset itself, rather than presenting extensive quantitative results derived from its use. However, it details the structure and content of the dataset, including various sentiment scores (e.g., bear_score, bull_score, normal_sentiment_weighted), image classification (type_post_content), and meta-information. The dataset is designed to be aggregated on 20-minute, hourly, or daily bases for time-series analyses, and its features are intended for machine learning prediction tasks, such as analyzing the influence of sentiment on stock prices.
Limitations and Future Work
The authors acknowledge that the time series sequences in the dataset are relatively short, typically tracking posts for no longer than 24 hours. They also note the presence of outliers in some variables, such as realized percentage gains, which they chose not to exclude to allow researchers to handle them as they see fit. Future work could involve extending the time series, exploring more sophisticated image analysis techniques, and applying the dataset to various predictive modeling tasks in financial forecasting and behavioral finance.
Summary updated