Abstract
Pieter Delobelle, Murilo Cunha, Eric Massip Cano, Jeroen Peperkamp, Bettina Berendt. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop.
2019.
Introduction
Online discourse is frequently plagued by logical fallacies, with the ad hominem attack being one of the most destructive. These attacks target the person making an argument rather than the argument itself, derailing productive debate. While human moderators work tirelessly to flag these posts, the sheer volume of content makes manual oversight unsustainable.
The technical challenge lies in the diversity of these attacks. They range from blatant name-calling to more subtle circumstantial attacks (e.g., "You only say that because you're a smoker"). Previous attempts using TF-IDF (Term Frequency-Inverse Document Frequency) often fail because they rely on specific keywords and ignore the sequential structure and grammatical context that signal an attack. Researchers from KU Leuven have developed a machine learning approach to automatically detect these fallacies by combining word embeddings, grammatical structures, and paragraph-level context.
Methodology
The authors propose a multi-input neural network architecture designed to capture different facets of language. The model integrates three distinct types of input features to provide a holistic view of the text:
- Word-Level Semantics: Word2vec embeddings represent individual word meanings. These are processed through a Bidirectional Gated Recurrent Unit (Bi-GRU), allowing the model to understand a word's meaning based on both preceding and succeeding context.
- Grammatical Structure: To capture the "shape" of an attack (e.g., "You are [adjective] [noun]"), the model utilizes Part-Of-Speech (POS) tagging. These tags are also fed into a separate Bi-GRU.
- Paragraph Context: Doc2vec (Par2vec) generates a single vector representing the entire paragraph's theme.
The outputs of these three components are concatenated and passed through two fully connected (dense) layers. The final output is a sigmoid activation representing the probability that the input contains an ad hominem attack.
Data and Experimental Setup
The study utilizes a dataset derived from the Reddit community r/ChangeMyView (CMV). This community is ideal because it has strict moderation rules against personal attacks, providing a "natural" source of labeled data from posts removed by moderators. The authors performed extensive data cleaning, removing Markdown formatting, links, and citations to focus purely on the user's original text. The final test set contained over 8,000 labeled paragraphs.
Results and Analysis
The RNN model (specifically with a word limit of $L=200$) emerged as the top performer. It achieved a recall of 80.2%, meaning it caught the vast majority of personal attacks, and an F1-score of 0.488, significantly outperforming CNN and SVM baselines.
As shown in the Receiver Operating Characteristic (ROC) curve, the model demonstrates strong discriminative power with an Area Under the Curve (AUC) of 0.91. This is particularly impressive given the heavy class imbalance typical of moderation datasets. The model also achieved a Gini coefficient of 0.664.
Key insights from the analysis include:
- Sequence Matters: The failure of TF-IDF baselines proves that detection isn't just about "bad words." The RNN’s ability to process sequences is what gives it the edge.
- Grammar as a Signal: By including POS tags, the model learns structural patterns of abuse that might use "clean" vocabulary but follow a recognizable aggressive syntax.
- The "Middle" Problem: The model is much more confident when an attack appears at the beginning or end of a paragraph. Attacks buried in the middle of long, otherwise neutral paragraphs are significantly harder to detect.
Discussion and Limitations
The authors identify two primary areas for improvement. First, the positional sensitivity suggests that an Attention Mechanism could help the model "focus" on relevant parts of a paragraph regardless of their position. Second, the authors observed catastrophic forgetting during online learning experiments; when the model retrained on new user-provided examples, its overall accuracy plummeted. This suggests that simple incremental updates are insufficient and require more sophisticated "human-in-the-loop" training strategies. Finally, the paper notes that emerging transformer-based models like BERT could be a powerful alternative to the GRU-based architecture for future research.
Summary updated