Placing M-Phasis on the Plurality of Hate: A Feature-Based Corpus of Hate Online

Dana Ruiter, Liane Reiners, Ashwin Geet D'Sa, Thomas Kleinbauer, Dominique Fohr, Irina Illina, Dietrich Klakow, Christian Schemer, Angeliki Monnier

Introduction: Beyond the Binary of Hate

Most existing hate speech (HS) datasets suffer from over-simplification, typically reducing complex human interactions to a binary "hate" vs. "not hate" label. This approach often fails to capture the subjectivity of offense, misses subtle "dog-whistle" implicit hate, and lacks the conversational depth found in real-world news comment sections.

The M-Phasis corpus addresses these gaps by treating hate as a "plural" phenomenon—a combination of negative evaluations, group contrasting, and calls for action. By providing a bilingual (German and French) dataset of approximately 9,000 comments annotated with 23 distinct features, this research offers a more robust framework for understanding the nuances of online migration debates.

The Multi-Module Annotation Framework

To capture the granular nature of online discourse, the researchers developed a multi-disciplinary annotation protocol. This framework breaks down comments into five key modules designed to identify the specific components of hateful or critical speech.

The M-Phasis multi-module annotation workflow, illustrating the sequential analysis of comment types, evaluations, actions, contrasts, and emotions.
  • Negative/Positive Evaluations (c_ne/c_pe): Identifies if an agent (e.g., a politician or migrant) is being judged and whether that judgment is explicit or implicit.
  • Action Recommendations (c_act): Captures whether a user suggests specific actions, ranging from humanitarian aid to deportation or violence.
  • Group Contrasting (c_contr): Detects "Us vs. Them" dynamics, such as the perceived divide between "the elite" and "the people."
  • Emotions (c_emo): Tracks expressions of fear, anger, or sarcasm.

The M-Phasis Corpus

The resulting dataset consists of ~9,000 user comments (4.6k French, 4.8k German) sourced from news articles related to migration. Unlike Twitter-based datasets, M-Phasis includes hierarchical context—the original article and parent comments—allowing for context-sensitive analysis. The sampling includes both mainstream media (e.g., Le Monde, Tagesschau) and fringe outlets (e.g., Riposte Laïque, Compact), ensuring a broad spectrum of political discourse.

Key Insights: The "Agent-Victim" Triple

A core finding of the study is that hate speech in migration debates is rarely a simple directed arrow; it often functions as a triangle involving an Agent, an Evaluation, and a Victim.

Sankey diagrams illustrating the flow of negative evaluations from Agents (like politicians or migrants) through specific traits (like passivity or hypocrisy) to the perceived Victims.

Interestingly, in the context of migration, politicians were more frequently the targets of negative evaluations than migrants themselves. Users often evaluated politicians negatively for their perceived "passivity" or "hypocrisy," arguing that these traits harmed the local population. This suggests that much of what is flagged as "hate speech" in these contexts is actually a form of extreme political grievance. Furthermore, by avoiding slur-based sampling, the corpus successfully captures implicit hate conveyed through reasoning, such as claiming a group represents a "financial burden."

Results and Implications

The researchers tested the corpus using transformer-based baselines (BERT and CamemBERT). While inter-annotator agreement was high ($0.77 \le \kappa \le 1$), classification proved difficult, with F1 scores mostly in the 0.30 to 0.60 range. This highlights that fine-grained tasks—such as identifying the specific victim of an evaluation—are significantly more challenging for current AI than simple binary detection.

Additionally, the study revealed a significant "domain shift": models trained on mainstream media performed poorly on fringe media. This suggests that classifiers used by social media platforms may be blind to the specific linguistic styles and arguments used in extremist echo chambers. However, joint training on French and German data improved performance on complex tasks, indicating that the underlying structure of hateful arguments often transcends language barriers.

Summary updated

BibTeX
@inproceedings{ruiter2022placing,
  author = {Dana Ruiter and Liane Reiners and Ashwin Geet D'Sa and Thomas Kleinbauer and Dominique Fohr and Irina Illina and Dietrich Klakow and Christian Schemer and Angeliki Monnier},
  title = {{Placing M-Phasis on the Plurality of Hate: A Feature-Based Corpus of Hate Online}},
  booktitle = {LREC},
  year = {2022},
}
Figure