Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit

Giuseppe Russo, Manoel Horta Ribeiro, Robert West

Abstract

Mainstream social media platforms often struggle to contain the growth of fringe communities, such as extremist or misogynistic groups. This study identifies "fringe-interactions"—interpersonal exchanges between fringe community members and non-members in mainstream subreddits—as a potent recruitment mechanism. Using causal inference and text-based matching on Reddit data, we demonstrate that receiving a comment from a fringe user significantly increases the likelihood of a non-member joining that fringe community. This effect is specific to fringe groups and is amplified by toxic language and specific subreddit environments.

Introduction

Moderation strategies on platforms like Reddit typically focus on "hard" measures, such as banning or quarantining problematic subreddits. However, these communities often prove resilient. This research investigates an overlooked growth engine: fringe-interactions. These occur when a member of a fringe community (e.g., r/Incel, r/The_Donald) interacts with a non-member in a mainstream space. We ask whether these cross-community interactions serve as a recruitment tool and if this mechanism is unique to fringe groups compared to mainstream ones like r/NBA or r/leagueoflegends.

Methodology

To establish a causal link between interactions and community joining, the authors employed a quasi-experimental design using Balanced Risk Set Matching.

  1. Causal Modeling: The researchers developed a causal graph accounting for user history, post context, and comment content to isolate the effect of the interaction.
  2. Text-Based Matching: Using a fine-tuned BERT model, "treated" users (those receiving a fringe reply) were matched with "control" users who posted similar content in the same subreddit at the same time but did not receive such a reply.
  3. Propensity Score Modeling: The probability of receiving a fringe interaction was modeled based on a user's "fringe score" (similarity of their current subreddit activity to fringe content) and general activity levels.
  4. Regression Analysis: A linear model estimated the "treatment effect"—the change in probability of joining the fringe community within eight weeks post-interaction.

The study analyzed a massive dataset from the Pushshift API, including 15 million posts from 700,000 users across fringe groups (r/Incel, r/GenderCritical, r/The_Donald) and 5 million posts from 1 million users for control groups (r/climatechange, r/NBA, r/leagueoflegends).

Key Results

The Fringe-Specific Growth Engine

A primary finding is that the recruitment effect is largely unique to fringe communities. While mainstream communities like r/NBA show negligible growth from such interactions, fringe groups see a significant "lift." Interacting with a fringe user increased the probability of joining r/Incel by 4.2 percentage points (pp), r/GenderCritical by 2.4 pp, and r/The_Donald by 2.2 pp.

Figure 3: Effect size of fringe vs. non-fringe interactions on community joining probability.

Temporal Dynamics and Toxicity

The recruitment effect is not instantaneous. The probability of joining typically peaks in the second week following the interaction before gradually declining.

Figure 4: Temporal probability of joining fringe and control communities over eight weeks post-interaction.

Counter-intuitively, toxic interactions were 5 percentage points more effective at attracting newcomers than non-toxic ones. This suggests that the aggressive nature of fringe discourse may appeal to specific susceptible audiences. Furthermore, recruitment success was highly context-dependent; right-leaning and masculine-skewing subreddits acted as "fertile ground," where an interaction with an r/Incel user could increase joining probability by up to 15.3 pp.

Discussion

These findings suggest that fringe communities rely on interpersonal "interventions" in mainstream spaces to grow, whereas normal communities grow through standard platform affordances. This has significant policy implications: moderation might need to shift from banning entire communities to managing the visibility of fringe users in mainstream spaces (e.g., shadow-banning or limiting cross-community reach). However, such measures raise ethical concerns regarding free speech and potential further radicalization.

Limitations

As an observational study, unobserved confounders (e.g., external platform activity) may influence results. Additionally, the findings are specific to Reddit's structure and may vary on platforms with different community boundaries like X or Telegram.

Summary updated

BibTeX
@inproceedings{russo2024stranger,
  author = {Giuseppe Russo and Manoel Horta Ribeiro and Robert West},
  title = {{Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit}},
  booktitle = {ICWSM},
  year = {2024},
  doi = {10.1609/icwsm.v18i1.31393},
}
Figure