Abstract
YouTube is by far the largest host of user-generated video content worldwide. Alas, the platform has also come under fire for hosting inappropriate, toxic, and hateful content. One community that has often been linked to sharing and publishing hateful and misogynistic content are the Involuntary Celibates (Incels), a loosely defined movement ostensibly focusing on men's issues. In this paper, we set out to analyze the Incel community on YouTube by focusing on this community's evolution over the last decade and understanding whether YouTube's recommendation algorithm steers users towards Incel-related videos. We collect videos shared on Incel communities within Reddit and perform a data-driven characterization of the content posted on YouTube. Among other things, we find that the Incel community on YouTube is getting traction and that, during the last decade, the number of Incel-related videos and comments rose substantially. We also find that users have a 6.3% chance of being suggested an Incel-related video by YouTube's recommendation algorithm within five hops when starting from a non Incel-related video. Overall, our findings paint an alarming picture of online radicalization: not only Incel activity is increasing over time, but platforms may also play an active role in steering users towards such extreme content.
Introduction
The "Incel" movement—a fringe community within the broader "Manosphere"—has become a subject of intense scrutiny due to its links to severe real-world violence and misogynistic ideologies. While platforms like Reddit have taken steps to ban prominent Incel subreddits, research suggests that such interventions often lead to community migration rather than dissolution. This paper investigates the establishment and growth of the Incel community on YouTube, specifically examining whether the platform's recommendation engine serves as a pipeline for radicalization into "blackpill" ideology—the belief that one's life outcomes are pre-determined by physical attractiveness.
Methodology
The researchers employed a multi-step data-driven approach to characterize the community:
- Data Collection: Identification of 19 Incel-related subreddits to extract 6.5K unique YouTube links ("Incel-derived" set), alongside a control set of 5.7K random YouTube videos shared on Reddit.
- Lexicon Building: Development of a 200-term "Incel Lexicon" derived from the "Incel Wiki" and manually filtered for relevance.
- Video Annotation: Classification of videos as "Incel-related" based on the presence of lexicon terms in both video transcripts and user comments.
- Recommendation Analysis: Construction of recommendation graphs using the YouTube Data API to simulate user navigation via "random walks."
Evolution and the "Hydra" Effect
A key finding is the resilience of the community against platform bans. When Reddit banned /r/Incels in late 2017, activity did not vanish; instead, it surged in alternative subreddits like /r/Braincels and migrated significantly to YouTube.
This migration is reflected in the massive growth of engagement on YouTube. The number of unique commenters on Incel-related videos grew by over 1,000% between 2017 and 2019, indicating a rapidly expanding and increasingly persistent audience.
Algorithmic Recommendations and Radicalization
The study reveals that YouTube’s recommendation algorithm may inadvertently nudge users toward extreme content. Analysis shows:
- The Algorithmic Nudge: A user starting from a random video has a 6.3% chance of being recommended an Incel-related video within five clicks.
- The "Rabbit Hole" Effect: The probability of encountering Incel content increases significantly if a user has already engaged with such videos, reaching up to 30% in certain recommendation paths.
- Prevalence: In the Incel-derived recommendation graph, 2.9% of all suggested videos were classified as Incel-related, compared to 1.5% in the control graph.
Conclusion and Limitations
The findings paint an alarming picture of online radicalization. The Incel community is not only growing but is also being supported by algorithmic structures that can steer neutral users toward extremist ideologies.
However, the study notes that the YouTube Data API provides generic recommendations. Real-world personalization based on individual watch history might make these radicalization pathways even more aggressive. Future research should explore cross-platform dynamics and the evolving nature of the community's coded language to improve detection and moderation strategies.
Summary updated