Linking Twitter Events With Stock Market Jitters

Fani Tsapeli, Nikolaos Bezirgiannidis, Peter Tiño, Mirco MusolesiarXiv 2017 · OpenReview

TL;DR

This paper introduces a novel Financial Event Detector (FED) that leverages Twitter data to identify financial and political events impacting stock markets. Unlike previous methods focusing solely on sentiment, FED uses multi-dimensional feature vectors derived from tweet content, author information, and geographical distribution to predict stock market jitters with impressive accuracy.

What Problem Does This Paper Address?

Predicting stock market fluctuations, often termed "jitters," is crucial for investors and financial analysts. While social media, particularly Twitter, has shown potential for improving these predictions, previous research has largely focused on using aggregated sentiment scores. This approach, however, misses a wealth of information embedded within the tweets themselves. The authors identify a gap in exploring how to effectively utilize the rich, multi-faceted information from Twitter to detect specific financial and political events that directly influence stock market movements, rather than just general sentiment. They aim to build a system that can pinpoint these impactful events in near real-time.

Methods

The core of the proposed solution is the Financial Event Detector (FED), which operates in three main stages:

  1. Bursty Words Detection: The system monitors the arrival rate of words in a stream of tweets. It identifies "bursty" words – those experiencing a sudden, significant increase in frequency – using a threshold-based approach on both the word's rate and its rate of change. This is modeled as an inhomogeneous Poisson process.
  2. Events Feature Vectors Extraction: When a bursty word is detected, an event is initiated. This event is then represented by a feature vector. Crucially, this vector is multi-dimensional, incorporating not just the bursty words themselves but also:
  3. Geographical distribution of tweets: Where the discussion is happening.
  4. Tweet polarity: The sentiment expressed.
  5. Author characteristics: Such as follower count and verification status.
  6. Word categories: Bursting words are grouped using hierarchical clustering based on their temporal correlation, creating features for each category (e.g., number of bursty words, maximum bursty rate).
  7. Other features: Including sentiment strength indices (both weighted and unweighted), location dispersion, and weighted average distance from the stock market location. These feature vectors are updated dynamically as new tweets related to the event arrive, capturing the event's evolution.

  8. Events Filtering: Not all detected Twitter events influence the stock market. To address this, the system trains a classifier using stock market volatility data. This allows it to distinguish between "positive" events (those that cause market jitters) and "negative" events (those with little to no impact). The training set is created automatically by correlating tweet event activity with periods of high and low stock market volatility, eliminating the need for manual labeling. The classifier is updated dynamically as new data becomes available.

A key aspect of their approach is feature selection, where they employ correlation-based and information gain methods to identify the most discriminative features for distinguishing between impactful and non-impactful events.

Datasets

The study utilizes two primary datasets:

  • Twitter Data: Tweets related to the European financial crisis were collected for Greece and Spain. Keywords were extracted using the RAKE method from Wikipedia and filtered based on score and relevance.
  • Stock Market Data: High-frequency (5-minute interval) intraday data for the ATHEX (Greek) and IBEX (Spanish) stock market indexes were used for the period of March 1, 2015, to November 1, 2015.

The authors use the first four months of Twitter data for parameter tuning and classifier training, and the remaining data for evaluation.

Key Insights and Ideas

  • Beyond Sentiment: The most significant insight is that relying solely on tweet sentiment for stock market prediction is insufficient. Multi-dimensional feature vectors, incorporating aspects like geographical spread, author influence, and the specific nature of bursty words, capture crucial information that sentiment alone misses.
  • Self-Supervised Learning for Event Labeling: The ability to train a classifier using only stock market volatility data to label Twitter events as "positive" or "negative" is a major contribution. This bypasses the laborious and subjective process of manual event annotation.
  • Dynamic Event Representation: Events are not static snapshots but are modeled as evolving entities. Feature vectors are updated dynamically, allowing the system to capture the changing nature and potential strengthening of an event over time.
  • Focus on Causality, Not Just Correlation: The goal is to identify events that cause stock market jitters, not just those that are correlated with them. This is achieved by linking Twitter event features directly to observed stock market volatility.

Key Results

The proposed Financial Event Detector (FED) demonstrates strong performance:

  • High Accuracy: FED achieves up to 74.32% F1 score on the Greek and Spanish stock market datasets.
  • Superiority over Baselines:
    • Compared to a general-purpose event detector (EDCOW), FED significantly outperforms it in detecting events that influence the stock market.
  • A sentiment-based event detector also performs poorly, highlighting the limitations of sentiment-only approaches.
  • Early Detection: The system successfully predicts most stock market jitters, often identifying them on Twitter before they appear on the stock market.
  • Mutual Information Analysis: The study shows a significant dependence between stock market jitters and events detected by FED, with much weaker dependence observed for the baseline methods.

Limitations and Future Work

  • Threshold Sensitivity: While the authors aim to minimize thresholds, their selection can still impact performance. They discuss criteria for choosing these values and their impact.
  • Event Duration Limit: Events are considered inactive after 24 hours, which might miss longer-term impacts.
  • Misclassification Bursts: False positive classifications can occur in bursts, especially when multiple updates of the same event are misclassified. The dynamic classifier update mechanism aims to mitigate this.
  • Future Work: The paper suggests further exploration of feature selection to identify truly important features and potentially extending the model to other financial markets or event types. The authors also note that the dynamic nature of the classifier allows for continuous improvement as more data becomes available.

Summary updated

Abstract

Predicting investors reactions to financial and political news is important for the early detection of stock market jitters. Evidence from several recent studies suggests that online social media could improve prediction of stock market movements. However, utilizing such information to predict strong stock market fluctuations has not been explored so far. In this work, we propose a novel event detection method on Twitter, tailored to detect financial and political events that influence a specific stock market. The proposed approach applies a bursty topic detection method on a stream of tweets related to finance or politics followed by a classification process which filters-out events that do not influence the examined stock market. We train our classifier to recognise real events by using solely information about stock market volatility, without the need of manual labeling. We model Twitter events as feature vectors that encompass a rich variety of information, such as the geographical distribution of tweets, their polarity, information about their authors as well as information about bursty words associated with the event. We show that utilizing only information about tweets polarity, like most previous studies, results in wasting important information. We apply the proposed method on high-frequency intra-day data from the Greek and Spanish stock market and we show that our financial event detector successfully predicts most of the stock market jitters.
BibTeX
@misc{tsapeli2017linking,
  author = {Fani Tsapeli and Nikolaos Bezirgiannidis and Peter Tiño and Mirco Musolesi},
  title = {{Linking Twitter Events With Stock Market Jitters}},
  year = {2017},
  eprint = {1709.06519},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1709.06519},
}
Figure