Heterogeneous Graph Attention Networks for Early Detection of Rumors on Twitter

Qi Huang, Junshuai Yu, Jia Wu, Bin Wang

TL;DR

This paper introduces a novel heterogeneous graph attention network (HGAT) to combat the spread of rumors on Twitter. By constructing a graph that connects tweets, words, and users, and then employing a subgraph attention mechanism, the model effectively captures both the semantic content of rumors and their propagation patterns, leading to improved early detection accuracy.

What Problem Does This Paper Address?

The proliferation of social media has made it incredibly easy to spread information, but this also facilitates the rapid dissemination of false rumors. These rumors can cause public panic and damage reputations, making automatic rumor detection a critical need. While existing methods often focus on analyzing text content, user profiles, or propagation patterns individually, they frequently overlook the "global semantic relations" between different pieces of text, which can be crucial for understanding the underlying meaning and commonalities of rumors. This paper aims to bridge this gap by developing a model that can leverage both the rich semantic information within rumor texts and the structural patterns of how they spread across the Twitter network.

Methods

The core of this work is a Heterogeneous Graph Attention Network (HGAT). Here's a breakdown of their approach:

  1. Heterogeneous Tweet-Word-User Graph Construction: They build a graph where nodes represent source tweets, words within those tweets, and users who interact with them. Edges connect:
  2. Tweet-Word: Based on word occurrence and TF-IDF scores.
  3. Word-Word: Based on co-occurrence statistics and Pointwise Mutual Information (PMI) to capture semantic relationships between words.
  4. Tweet-User: Based on user interactions (retweets, replies) with tweets.
  5. Subgraph Decomposition: To manage the complexity and focus on specific relationships, the heterogeneous graph is decomposed into two subgraphs based on meta-paths:
  6. Tweet-Word Subgraph: Captures the semantic relationships between tweets and words.
  7. Tweet-User Subgraph: Captures the propagation patterns between tweets and users.
  8. Subgraph Attention Network: For each subgraph, a graph attention mechanism is applied. This allows the model to learn the importance of neighboring nodes when computing a node's representation, effectively capturing local and global structural information within each subgraph.
  9. Subgraph-Level Attention: Crucially, an attention mechanism is introduced to fuse the information learned from the tweet-word and tweet-user subgraphs. This allows the model to dynamically weigh the importance of semantic content versus propagation structure for rumor detection.
  10. Rumor Detection: Finally, the aggregated tweet representations are fed into a simple feedforward neural network with softmax normalization to predict the probability of a tweet being a rumor.

Datasets

The experiments were conducted on two publicly available Twitter datasets:

  • Twitter15: Contains 1,490 source tweets.
  • Twitter16: Contains 818 source tweets.

These datasets are labeled as non-rumor, false rumor, true rumor, or unverified rumor. The authors also mention crawling user profiles via the Twitter API to enrich the data, as these were not originally included.

Key Insights and Ideas

  • Global Semantics Matter: The paper strongly emphasizes that considering the global semantic relationships between words and tweets, not just local features, is key to better rumor detection.
  • Heterogeneity is Power: By explicitly modeling the diverse relationships (tweet-word, word-word, tweet-user) in a heterogeneous graph, the model gains a more comprehensive understanding of rumors.
  • Subgraph Fusion is Crucial: The subgraph-level attention mechanism effectively balances the contributions of textual semantics (tweet-word subgraph) and propagation dynamics (tweet-user subgraph), showing that neither alone is sufficient.
  • Early Detection Advantage: The proposed method demonstrates a strong ability to detect rumors even at very early stages of propagation, which is vital for mitigating their impact.

Key Results

The proposed HGAT model achieved state-of-the-art performance on both Twitter15 and Twitter16 datasets.

  • Overall Accuracy: Achieved an accuracy of 91.1% on Twitter15 and 92.4% on Twitter16, outperforming the best baseline by 2.1% and 2.2% respectively.
  • Early Detection: In early detection scenarios (simulated by elapsed time or retweet count), the model consistently performed well, often outperforming other competitive methods like GLAN and PPC, demonstrating its robustness.
  • Subgraph Importance: The experiments showed that the tweet-word subgraph (text content) generally had a greater impact on rumor detection accuracy than the tweet-user subgraph (propagation structure), highlighting the importance of semantic analysis. However, for the non-rumor class specifically, the tweet-user subgraph showed a stronger influence.

Limitations and Future Work

  • Social Relationship Integration: The authors acknowledge that integrating the social relationships of users (beyond just interactions with specific tweets) into the heterogeneous graph is a promising direction for further improving early rumor detection.
  • Noise in Large Networks: The paper notes that as more information becomes available (e.g., longer elapsed time, more retweets), accuracy can fluctuate slightly due to increased noise in the data. This suggests a need for models that are more robust to noisy information.

Summary updated

Abstract

With the rapid development of mobile Internet technology and the widespread use of mobile devices, it becomes much easier for people to express their opinions on social media. The openness and convenience of social media platforms provide a free expression for people but also cause new social problems. The widespread of false rumors on social media can bring about the panic of the public and damage personal reputation, which makes rumor automatic detection technology become particularly necessary. The majority of existing methods for rumor detection focus on mining effective features from text contents, user profiles, and patterns of propagation. Nevertheless, these methods do not take full advantage of global semantic relations of the text contents, which characterize the semantic commonality of rumors as a key factor for detecting rumors. In this paper, we construct a tweet-word-user heterogeneous graph based on the text contents and the source tweet propagations of rumors. A meta-path based heterogeneous graph attention network framework is proposed to capture the global semantic relations of text contents, together with the global structure information of source tweet propagations for rumor detection. Experiments on real-world Twitter data demonstrate the superiority of the proposed approach, which also has a comparable ability to detect rumors at a very early stage.
BibTeX
@inproceedings{huang2020heterogeneous,
  author = {Qi Huang and Junshuai Yu and Jia Wu and Bin Wang},
  title = {{Heterogeneous Graph Attention Networks for Early Detection of Rumors on Twitter}},
  booktitle = {IJCNN},
  year = {2020},
  url = {https://openreview.net/forum?id=LNiLtOrtGkw},
}

Loading related content...

Figure