Distinguishing In-Groups and Onlookers by Language Use

Joshua Minot, Milo Trujillo, Samuel Rosenblatt, Guillermo De Anda-Jáuregui, Emily Moog, Allison M. Roth, Briane Paul Samson, Laurent Hébert-DufresneACL 2022

TL;DR

This paper tackles the challenge of distinguishing between users who are members of an online community (in-group) and those who are merely discussing it (onlookers), using only their language. They introduce a novel classifier and a new dataset of Reddit subreddits to demonstrate its effectiveness, showing that language alone can be a powerful signal for inferring group affiliation.

What Problem Does This Paper Address?

Online communities wield significant influence, but studying them is complicated by the difficulty of tracking users across platforms and understanding their true affiliation. Traditional methods often rely on network interactions, which are incomplete in a multi-platform world. While language analysis is a promising alternative, it struggles to differentiate between genuine in-group members and outsiders who use similar terminology when discussing the group. This ambiguity can lead to misinterpretations in analyses of public opinion, narrative trends, and community dynamics. The authors aim to bridge this gap by developing a method to distinguish in-group language from onlooker language.

Methods

The core of the paper is a language-based classifier designed to distinguish between in-group and onlooker users. They frame this as a binary classification problem.

  • Data Collection: They curated a dataset of seven pairs of Reddit subreddits. Each pair consists of an "in-group" subreddit focused on a specific topic (e.g., COVID conspiracies) and an "onlooker" subreddit that discusses the first community. This pairing allows them to use participation in the in-group subreddit as a noisy label for group membership.
  • Feature Engineering: They primarily used TF-IDF (Term Frequency-Inverse Document Frequency) features, which are standard for text classification. They also experimented with a Longformer model, a transformer-based architecture capable of processing longer text sequences, which is beneficial for analyzing entire comment histories.
  • Classification Models: They trained and evaluated two models:
  • A logistic regression model using TF-IDF features.
  • A Longformer-based sequence classifier.
  • Divergence Analysis: To understand the linguistic differences between communities, they employed Rank-Turbulence Divergence (RTD). This metric helps identify specific n-grams (words or phrases) that contribute most to the divergence in language use between two subreddits.

Datasets

The authors introduce a novel dataset consisting of seven pairs of Reddit subreddits. These pairs were carefully selected to represent distinct in-group and onlooker communities. Examples include:

  • r/NoNewNormal (COVID conspiracy) vs. r/CovIdiots (discussing COVID conspiracy theorists)
  • r/TheRedPill (male dating strategy) vs. r/TheBluePill (satirical subreddit targeting r/TheRedPill)
  • r/ProtectAndServe (law enforcement professionals) vs. r/Bad_Cop_No_Donut (criticism of law enforcement)

They filtered out bot users and users with very low comment activity or karma to ensure data quality.

Key Insights and Ideas

  • Language as a Social Signal: The research strongly suggests that language use, even without explicit network data, can be a powerful indicator of group affiliation and the distinction between being in a group versus talking about it.
  • The "Onlooker" Problem: A significant challenge is that outsiders discussing a group often use similar keywords as insiders. The classifier's success in disentangling these signals is a key contribution.
  • Contextual Language Matters: The Longformer model, capable of processing longer comment histories, generally outperformed the simpler TF-IDF approach, highlighting the importance of contextual information in language analysis for this task.
  • RTD for Linguistic Fingerprinting: Rank-Turbulence Divergence proved effective in pinpointing specific words that uniquely characterize each community, offering insights into their distinct linguistic profiles.

Key Results

  • Classifier Performance: Both the logistic regression and Longformer classifiers performed significantly better than random chance across all subreddit pairs.
  • Longformer Superiority: The Longformer model generally achieved higher performance (measured by MCC, precision, and recall) than the logistic regression model, especially on the "thresholded" dataset (users with more substantial activity).
  • COVID-19 Case Study: The r/NoNewNormal and r/CovIdiots pair, their primary case study, showed good classification performance (AUC of 0.83 for the Longformer model).
  • Feature Importance: For the logistic regression model, specific words like "media," "doomer," and "trump" were highly predictive of r/NoNewNormal accounts, while "idiots," "crocs," and "5g" were predictive of r/CovIdiots accounts.
  • Impact of Classifier on Distributions: The study showed that using classifier-derived labels for language distribution analysis produced results qualitatively similar to using ground truth labels, suggesting the classifier's reliability.

Limitations and Future Work

  • Data Limitations: The dataset covers a specific time frame, and models trained on older data might perform poorly on newer data. The classifier is also limited to English posts.
  • Dynamic Opinions: The methodology does not account for users changing their opinions or group affiliations over time.
  • Future Directions:
    • Cross-lingual Classification: Extending the classifier to other languages.
  • Incorporating More Features: Exploring user sentiment, shared topics, stance, and language style beyond just n-grams.
  • Advanced Models: Investigating different model architectures and hyperparameters, including higher-order n-grams and more domain-specific word embeddings.
  • Temporal Dynamics: Developing methods to track opinion shifts and evolving group language.

Summary updated

BibTeX
@inproceedings{minot2022distinguishing,
  author = {Joshua Minot and Milo Trujillo and Samuel Rosenblatt and Guillermo De Anda-Jáuregui and Emily Moog and Allison M. Roth and Briane Paul Samson and Laurent Hébert-Dufresne},
  title = {{Distinguishing In-Groups and Onlookers by Language Use}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2022},
}
Figure