Unifying the Extremes: Developing a Unified Model for Detecting and Predicting Extremist Traits and Radicalization

Allison Lahnala, Vasudha Varadarajan, Lucie Flek, H. Andrew Schwartz, Ryan L. Boyd

TL;DR

This paper introduces a novel NLP-based framework, the "Extremist Eleven," to identify and quantify generalized extremist traits across diverse online communities. This unified model can predict an individual's likelihood of joining extremist groups months in advance, offering a more holistic approach to understanding radicalization beyond specific ideologies.

What Problem Does This Paper Address?

The rise of online extremist movements poses a significant global concern. While much research has focused on radicalization within specific ideologies (e.g., white supremacy, religious extremism), there's a lack of a generalizable framework to characterize extremism across these diverse groups. Existing methods often struggle with ethical and logistical barriers to studying these populations directly. This paper aims to bridge this gap by leveraging social media data and NLP to develop a unified model that can identify common psychosocial drivers of extremism, regardless of the specific ideology.

Methods

The authors propose a novel method that combines Natural Language Processing (NLP) with established psychosocial theories of extremism. Their approach involves:

  1. Scale Score Extraction: Using NLP (specifically, sentence representations from the mxbai-embed-large-v1 model), they measure the cosine similarity between post content and 89 existing extremism scale items. This quantifies how closely a post aligns with various theoretical constructs of extremism.
  2. Factor Analysis: These extracted scores are then subjected to Exploratory Factor Analysis (EFA). This statistical technique identifies underlying latent factors that explain the correlations among the scale items. The EFA revealed 11 distinct factors, which the authors term "The Extremist Eleven." These factors represent generalized psychosocial dimensions of extremism.
  3. Downstream Analysis: The extracted "Extremist Eleven" scores are then aggregated at the user and forum levels to analyze community-level characteristics and individual radicalization trajectories.

This method is novel in its unsupervised approach to extracting and unifying a broad spectrum of extremist traits from text data, bypassing the need for manual labeling or direct engagement with extremist individuals.

Datasets

The study utilizes a diverse set of datasets to capture various forms of extremist and general discourse:

  • Extremist Communities:
    • White Supremacist Forum (WS): Posts from the Stormfront dataset.
  • Incel Reddit (IR): Comments and posts from r/Incels, r/Braincels, and r/Trufemcels subreddits.
  • ISIS Articles: Quotes from ISIS magazines Dabiq and Rumiyah.
  • General Discourse:
    • General Reddit (GR): Posts from a random sample of users across various non-extremist subreddits.
  • Politosphere Reddit (PR): Posts from both banned and non-banned political subreddits, used to contrast general political discourse with extremist tendencies.

The authors filtered posts to include only English, those with at least 10 words, and from 2010 onwards for consistency.

Key Insights and Ideas

  • Unified Model of Extremism: The "Extremist Eleven" provides a generalized psychosocial model that transcends specific ideologies, revealing common underlying traits across diverse extremist groups.
  • Predictive Power: The framework can predict an individual's future engagement with extremist communities before they actively join, suggesting that susceptibility to radicalization can be identified early.
  • Distinct Extremist Profiles: While some traits are common, different extremist groups exhibit unique "flavors" of extremism (e.g., ISIS leaning towards state control and dogmatism, incels towards moral detachment and cold calculation).
  • Language as a Proxy: The study demonstrates that language patterns on social media can serve as a reliable proxy for psychological constructs, enabling large-scale analysis without direct participant interaction.

Key Results

  • "Extremist Eleven" Identification: The EFA successfully identified 11 distinct factors that characterize extremist discourse.
  • Forum-Level Characterization: Figure 3 shows that extremist forums (White Supremacist, ISIS, Incel Reddit) exhibit significantly higher scores on various "Extremist Eleven" factors compared to General Reddit. For instance, ISIS scored higher on "State Control" and "Dogmatism," while White Supremacists scored higher on "Social Dominance Orientation," "Nationalism," and "Xenophobia." Incels showed higher "Moral Detachment" and "Cold and Calculating" traits.
  • Predicting Incel Community Entry: A logistic regression model using "Extremist Eleven" scores predicted users joining the Incel Reddit community with an AUC of > 0.6 up to 10 months prior to joining, increasing to ~0.9 three to four months before entry. This demonstrates strong early detection capabilities.
  • Post-Joining Behavior: Users joining the incel community showed a noticeable increase in extremist traits leading up to and shortly after joining, but these traits then stabilized, challenging the idea of constant amplification in "echo chambers."

Limitations and Future Work

  • Generalizability: The model's generalizability might be limited by the specific datasets and theories used, potentially not capturing the full complexity of radicalization across all contexts, cultures, and ideologies.
  • Oversimplification: Relying on psychological traits as predictors might oversimplify the radicalization process, potentially overlooking situational, social, or political factors.
  • Ethical Concerns: The authors acknowledge potential negative societal impacts, misuse of findings, and the risk of false positives or stigmatization. They emphasize responsible AI development and the need for careful application.
  • Future Work:
    • Expand datasets to include more diverse and cross-cultural cases.
  • Incorporate non-traditional data sources (e.g., network analysis, digital traces).
  • Develop "interactionist" models that combine individual traits with situational and sociocultural triggers.
  • Further investigate how extremist traits evolve over time, especially in relation to community joining and potential bans.

Summary updated

Abstract

The proliferation of ideological movements into extremist factions via social media has become a global concern. While radicalization has been studied extensively within the context of specific ideologies, our ability to accurately characterize extremism in more generalizable terms remains underdeveloped. In this paper, we propose a novel method for extracting and analyzing extremist discourse across a range of online community forums. By focusing on verbal behavioral signatures of extremist traits, we develop a framework for quantifying extremism at both user and community levels. Our research identifies 11 distinct factors, which we term ``The Extremist Eleven,'' as a generalized psychosocial model of extremism. Applying our method to various online communities, we demonstrate an ability to characterize ideologically diverse communities across the 11 extremist traits. We demonstrate the power of this method by analyzing user histories from members of the incel community. We find that our framework accurately predicts which users join the incel community up to 10 months before their actual entry with an AUC of $>0.6$, steadily increasing to AUC ~0.9 three to four months before the event. Further, we find that upon entry into an extremist forum, the users tend to maintain their level of extremism within the community, while still remaining distinguishable from the general online discourse. Our findings contribute to the study of extremism by introducing a more holistic, cross-ideological approach that transcends traditional, trait-specific models.
BibTeX
@misc{lahnala2025unifying,
  author = {Allison Lahnala and Vasudha Varadarajan and Lucie Flek and H. Andrew Schwartz and Ryan L. Boyd},
  title = {{Unifying the Extremes: Developing a Unified Model for Detecting and Predicting Extremist Traits and Radicalization}},
  year = {2025},
  eprint = {2501.04820},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2501.04820},
}
Figure