Consolidating Strategies for Countering Hate Speech Using Persuasive Dialogues

Sougata Saha, Rohini K. SrihariarXiv 2024 · OpenReview

TL;DR

This paper tackles the persistent problem of online hate speech by moving beyond reactive blocking to persuasive dialogue. They propose and test a novel approach using controllable language models that generate counter-arguments informed by psychological traits (Big-5 personality) and logical reasoning structures (argument schemes), aiming to change perpetrators' viewpoints rather than just silencing them.

What Problem Does This Paper Address?

Online hate speech is a pervasive issue, and current solutions like flagging and blocking are often superficial and temporary. The rise of powerful Large Language Models (LLMs) exacerbates this problem by enabling the rapid, large-scale dissemination of hateful content. The authors argue for a shift towards proactive, long-term solutions that engage directly with the perpetrators of hate speech. They aim to develop systems that can generate persuasive counter-arguments designed to alter the perpetrator's perspective or at least de-escalate their rhetoric, drawing inspiration from classical rhetoric (logos, ethos, pathos).

Methods

The core of the paper lies in developing controllable computational models for generating counter-arguments. They identify and utilize two main categories of features:

  • Value-based features: These capture human qualities and characteristics, specifically the Big-5 personality traits (Openness, Conscientiousness, Extraversion, Agreeableness, Neuroticism) and human values (e.g., Achievement, Benevolence, Security).
  • Structure-based features: These focus on the patterns of reasoning within arguments, including Walton's argument schemes (e.g., "From Consequence," "Rule or Principle") and argumentative discourse-based speech acts (e.g., Denouncing, Facts).

They developed computational models to automatically annotate existing hate speech dialogue datasets with these features. These annotated features then serve as "control codes" to guide language models (specifically, a BART-base encoder-decoder architecture) in generating counter-arguments. The models were trained and evaluated using various combinations of these features to determine their effectiveness.

Datasets

  • DialoConan dataset: This dataset, comprising over 3,000 multi-turn dialogues between a "hater" and an NGO operator, covers six hate targets (LGBT+, migrants, Muslims, Jews, people of color, and women). The authors used this dataset and supplemented it with pairs from the Conan dataset.
  • Conan dataset: This dataset was also used, providing hate speech/counter-narrative pairs.

The authors created a "silver-standard" annotated version of these datasets using their developed computational models.

Key Insights and Ideas

  • Beyond Brute Force: The paper strongly advocates for moving beyond simple blocking mechanisms to more nuanced, persuasive approaches to combatting online hate.
  • The Power of Personality and Logic: Incorporating features related to personality traits and argument structure significantly improves the quality and persuasiveness of generated counter-arguments.
  • Feature Combinations Matter: Not all features are equally effective, and their combination is crucial. The best results were achieved by combining Big-5 personality traits with argument schemes.
  • Diminishing Returns: Adding too many features can actually degrade performance, suggesting an optimal complexity for these models.
  • Human Values vs. Personality: Big-5 personality traits were found to be more impactful than human values in generating better counter-arguments.
  • Argument Schemes Trump Speech Acts: Argument schemes proved more effective than argument types (speech acts) for guiding counter-argument generation.

Key Results

  • Automatic Evaluation: Combining Big-5 personality traits and argument schemes yielded the best results in terms of BLEU and Rouge-L scores, indicating more convincing and relevant generated responses. The ensemble of all four feature types performed poorly.
  • Human Evaluation: Human evaluators rated responses incorporating Big-5 personality traits as more argumentative than the baseline. Responses incorporating argument schemes alone were rated lowest for argumentativeness. The combination of Big-5 personality and argument schemes performed well. All evaluated model variants produced fluent responses. Structure-based features (argument schemes and types) led to fewer hallucinations compared to value-based features.
  • Best Performing Combination: The combination of argument schemes and Big-5 personality traits consistently emerged as the most effective for generating persuasive counter-hate arguments, as evidenced by both automatic and human evaluations.

Limitations and Future Work

  • Automatic Annotations: The features used for annotation were automatically derived and not validated by human evaluators.
  • Synthetic Data: The hate speech corpus primarily consists of synthetically curated dialogues, and the generator's effectiveness on real-world online hate comments needs more extensive validation.
  • Limited Scope: The current work is limited to six topics in English, and performance on other topics or languages is not validated.
  • Future Work: The authors suggest exploring the hypothesis that increasing the number of features can improve language modeling by better partitioning conditional probabilities, but this requires more training data to avoid overfitting. They also plan to investigate the optimal number of feature combinations further.

Summary updated

Abstract

Hateful comments are prevalent on social media platforms. Although tools for automatically detecting, flagging, and blocking such false, offensive, and harmful content online have lately matured, such reactive and brute force methods alone provide short-term and superficial remedies while the perpetrators persist. With the public availability of large language models which can generate articulate synthetic and engaging content at scale, there are concerns about the rapid growth of dissemination of such malicious content on the web. There is now a need to focus on deeper, long-term solutions that involve engaging with the human perpetrator behind the source of the content to change their viewpoint or at least bring down the rhetoric using persuasive means. To do that, we propose defining and experimenting with controllable strategies for generating counter-arguments to hateful comments in online conversations. We experiment with controlling response generation using features based on (i) argument structure and reasoning-based Walton argument schemes, (ii) counter-argument speech acts, and (iii) human characteristics-based qualities such as Big-5 personality traits and human values. Using automatic and human evaluations, we determine the best combination of features that generate fluent, argumentative, and logically sound arguments for countering hate. We further share the developed computational models for automatically annotating text with such features, and a silver-standard annotated version of an existing hate speech dialog corpora.
BibTeX
@misc{saha2024consolidating,
  author = {Sougata Saha and Rohini K. Srihari},
  title = {{Consolidating Strategies for Countering Hate Speech Using Persuasive Dialogues}},
  year = {2024},
  eprint = {2401.07810},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2401.07810},
}
Figure