TL;DR
This paper introduces JDC, a novel dataset of targeted insults and compliments extracted from Reddit, designed to address the challenge of online abuse. The authors benchmark existing models for both detecting and transforming these negative comments, revealing that while detection is robust, style transfer remains a significant hurdle due to the creative nature of online insults.
What Problem Does This Paper Address?
Online platforms are rife with abuse and harassment, particularly impacting younger users. While significant effort has gone into detecting hate speech and offensive language, there's a notable gap in understanding and transforming targeted negative comments that, while not always using slurs, are creatively crafted to demean individuals. These indirect insults, often focusing on personal attributes like appearance, can be particularly damaging and are harder for current detection systems to flag. The paper aims to bridge this gap by creating a dataset specifically for this type of targeted abuse and evaluating the effectiveness of current NLP techniques in handling it.
Methods
The core of this work involves two main NLP tasks:
- Classification: Identifying whether a comment is an insult or a compliment. The authors evaluate standard machine learning models (Logistic Regression, SVM) and advanced transformer-based models (BERT, RoBERTa, XLNet) for this task.
- Unsupervised Text Style Transfer: Converting an insult into a compliment. This is a more challenging task, especially given the lack of parallel data (exact insult-compliment pairs). The paper tests several unsupervised style transfer models, including those based on disentanglement (StyleEmb, RetrieveOnly, DeleteRetrieve) and encoder-decoder architectures (LingST, Tag&Gen).
Datasets
The primary contribution is the Jibe and Delight Corpus (JDC), a new dataset comprising approximately 68,159 insult sentences and 51,102 compliment sentences. This dataset was collected from three Reddit subreddits: r/RoastMe (for insults) and r/ToastMe and r/FreeCompliments (for compliments).
Key characteristics of the JDC include:
- Targeted: Insults and compliments are directed at specific individual attributes (e.g., face, hair, eyes, personality) rather than general groups.
- Creative Insults: The
r/RoastMesubreddit encourages "creative" insults, often avoiding profanity and slurs, making them harder to detect with traditional methods. - Non-Parallel: The dataset consists of separate collections of insults and compliments, requiring unsupervised style transfer approaches.
For evaluation, 1,000 instances from each category were used.
Key Insights and Ideas
- The Nuance of "Creative" Insults: The paper highlights that insults from
r/RoastMeare often indirect and rely on wit and creativity, making them distinct from hate speech or simple profanity. This creativity is a major challenge for style transfer. - Detection is Achievable, Transfer is Not: While models can effectively classify insults and compliments with high accuracy, transforming an insult into a genuine compliment is significantly harder.
- Attribute-Specific Transfer is Tricky: The models struggle to preserve the original content while accurately conveying a positive sentiment and style. Often, the output is either grammatically awkward, nonsensical, or fails to capture the essence of a compliment.
- Directness in Compliments: Compliments tend to be more direct and less convoluted than insults, which simplifies their generation but also means that overly complex generated compliments might sound insincere.
Key Results
- Classification Performance: Transformer-based models like XLNet, BERT, and RoBERTa achieved high F1-scores (above 0.9) for classifying insults and compliments, indicating strong performance in detection.
- Style Transfer Performance:
- Models like RetrieveOnly, StyleEmb, and LingST showed high accuracy in style transfer but struggled with content preservation.
- Tag&Gen performed well on content preservation but failed to adequately transfer the style.
- DeleteRetrieve offered a balance but produced the least fluent sentences.
- Human evaluation revealed that while generated sentences were often judged as more fluent than the input, RetrieveOnly and LingST were more likely to be perceived as genuine compliments.
Limitations and Future Work
- Style Transfer Challenges: The authors acknowledge that current unsupervised style transfer models struggle with the creative and nuanced nature of insults, particularly in preserving content while achieving a natural and positive output.
- Attribute Focus: While the dataset focuses on attribute-based insults, some complex or context-dependent insults might still slip through the filtering.
- Future Directions: The paper suggests enhancing unsupervised text style transfer methodologies to better capture the intricacies of this dataset. Building more robust moderation systems for online platforms that can leverage these techniques is also a key future goal.
Summary updated