Anomaly Detection with Joint Representation Learning of Content and Connection

Junhao Wang, Renhao Wang, Aayushi Kulshrestha, Reihaneh RabbanyarXiv 2019 · arXiv

In the modern political landscape, social media serves as a critical infrastructure for public discourse. However, this infrastructure is increasingly targeted by "Information Operations"—coordinated campaigns designed to manipulate public opinion through propaganda and disinformation. Detecting these operations is challenging because sophisticated actors often mimic organic behavior in either their network connections or their messaging. Researchers from McGill and UBC have proposed a novel framework that identifies these suspicious groups by jointly analyzing both user connections and content.

Methodology: Joint Representation Learning

Traditional anomaly detection methods often operate in silos, focusing either on the network structure (who follows whom) or the content (what is being said). The proposed method addresses this by using a Joint Autoencoder architecture. This model simultaneously processes two distinct data sources: an Adjacency Matrix, representing the follower network, and an Attribute Matrix, representing hashtag usage.

The model processes both user adjacency (connections) and hashtag attributes (content) to create a joint representation.

The autoencoder compresses these inputs into a joint latent representation. A key innovation is the inclusion of a similarity loss function, which ensures that the distance between users in the latent space reflects their Jaccard distance (overlap) in the original data. This preserves local structures, ensuring that users who share specific, rare hashtags are grouped more tightly than those using generic ones. Following representation learning, the researchers use UMAP for dimensionality reduction and DBSCAN to identify dense clusters of users.

Evaluation and Key Results

To evaluate the model's effectiveness, the researchers used both synthetic data and a real-world dataset from the 2019 Canadian Federal Election. The synthetic data allowed for controlled testing by injecting "dense sub-blocks" (simulated troll groups) into the network to measure detection accuracy (F-1 Score).

Performance comparison on synthetic data shows the proposed joint approach outperforming FRAUDAR and DOMINANT across various sub-block densities.

The results demonstrate that the joint approach significantly outperforms existing baselines like FRAUDAR (network-only) and DOMINANT (a Graph Convolutional Network), particularly when the coordinated groups are less dense and harder to detect.

In the real-world Canadian election dataset, the model identified a suspicious cluster (Cluster #9) characterized by "multi-regional" hashtag spikes. While organic clusters typically focus on local issues, this cluster showed coordinated activity across different provinces on niche topics. Further investigation revealed accounts within these clusters that employed tactics like frequent handle-switching to evade detection while maintaining their follower base.

Conclusion

By integrating content and connection data into a single learning framework, this research provides a more robust tool for unmasking coordinated information operations. While human oversight remains necessary for final qualitative validation, the ability to automatically flag dense, coordinated sub-blocks represents a significant step forward in protecting the integrity of digital public squares.

Summary updated

Abstract

Social media sites are becoming a key factor in politics. These platforms are easy to manipulate for the purpose of distorting information space to confuse and distract voters. Past works to identify disruptive patterns are mostly focused on analyzing the content of tweets. In this study, we jointly embed the information from both user posted content as well as a user's follower network, to detect groups of densely connected users in an unsupervised fashion. We then investigate these dense sub-blocks of users to flag anomalous behavior. In our experiments, we study the tweets related to the upcoming 2019 Canadian Elections, and observe a set of densely-connected users engaging in local politics in different provinces, and exhibiting troll-like behavior.
BibTeX
@misc{wang2019anomaly,
  author = {Junhao Wang and Renhao Wang and Aayushi Kulshrestha and Reihaneh Rabbany},
  title = {{Anomaly Detection with Joint Representation Learning of Content and Connection}},
  year = {2019},
  eprint = {1906.12328},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1906.12328},
}
Figure