Characterizing Social Spambots by their Human Traits

Salvatore Giorgi, Lyle H. Ungar, H. Andrew SchwartzACL 2021 · DOI

Abstract

Social spambots have become increasingly adept at mimicking human language, often evading traditional detection methods. This study reveals that while individual bots may appear human-like, they lack the natural diversity found in genuine human populations. By analyzing 17 human-interpretable traits—including demographics, personality, and sentiment—researchers can identify bot populations that act as "clones." This approach achieves state-of-the-art detection performance, outperforming both previous automated methods and human annotators.

Introduction

The "Turing Test" for social media is evolving. Traditional spambots, characterized by repetitive links and aggressive advertising, are easily flagged. However, a new generation of social spambots has emerged, designed to spread misinformation and influence public opinion by convincingly emulating human behavior. These sophisticated bots often bypass metadata-based or keyword-heavy detection systems. This research investigates whether the "humanness" of these bots—specifically their personality, age, and emotional consistency—can be used to distinguish them from real users.

Methodology

The researchers shifted focus from raw text analysis to 17 human-interpretable attributes derived from tweet language:

  • Demographics: Age and gender estimated via predictive lexica.
  • Personality: The "Big Five" traits (Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism).
  • Sentiment: Positive and negative sentiment scores.
  • Emotions: Eight basic emotions (e.g., anger, joy, trust).

These features were used to train a Random Forest classifier (specifically Extremely Randomized Trees). Additionally, the team employed unsupervised spectral clustering to group accounts based on their "human" profiles, testing the model's ability to identify bots without prior labeled examples.

Datasets

The study utilized several Twitter bot corpora:

  • Social Spambot Sets (SSB1 & SSB2): Bots advertising products or apps alongside genuine human accounts.
  • Traditional Bot Sets: Open-source datasets containing content polluters and fake followers to test the model's generalizability.

Key Insights: The Clone Phenomenon

The most significant finding is the "Clone Phenomenon." While an individual social spambot might appear to be a typical user (e.g., a 29-year-old male), they lack the variance seen in human populations. Genuine humans exhibit a wide "bell curve" of traits, whereas bots are tightly clustered around a mean.

Distribution of Age and Gender for social spambots versus genuine users.

Bots are "too average." They avoid the "unhuman" extremes of traditional bots but fail to replicate the "long tails" of human diversity. Personality traits proved most predictive; bots often show lower neuroticism and higher positive sentiment, likely reflecting their promotional programming.

Results

The proposed method achieved state-of-the-art performance, reaching an F1 score of 0.946 for social spambot detection. This significantly outperforms human annotators and previous graph-based or DNA-inspired methods.

Performance comparison of the proposed method against past work and human annotators.

Even in unsupervised settings, the clustering algorithm achieved an F1 of 0.925 by identifying accounts that were "too similar" to one another. Furthermore, the 17 human traits performed on par with models using 1,000 unigrams across various datasets, demonstrating the robustness of these features.

Discussion and Limitations

While effective, this method faces an ongoing "arms race." Bot creators may eventually program artificial variance into their armies to mimic human population distributions more closely. Additionally, the reliance on pre-trained lexica for trait estimation means the model's accuracy is tied to the quality of these underlying tools. Future research should explore these patterns across different languages and cultural contexts to ensure global applicability.

Summary updated

BibTeX
@inproceedings{giorgi2021characterizing,
  author = {Salvatore Giorgi and Lyle H. Ungar and H. Andrew Schwartz},
  title = {{Characterizing Social Spambots by their Human Traits}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2021},
  doi = {10.18653/v1/2021.findings-acl.457},
}
Figure