Re-examining Sexism and Misogyny Classification with Annotator Attitudes

Aiqi Jiang, Nikolas Vitsakis, Tanvi Dinkar, Gavin Abercrombie, Ioannis Konstas

Abstract

This study challenges the conventional "gold standard" in sexism detection by incorporating annotator attitudes—specifically Right-Wing Authoritarianism (RWA) and Social Dominance Orientation (SDO)—into classification models. By moving beyond simple demographics and utilizing psychological profiling, the researchers demonstrate that Large Language Models (LLMs) can achieve up to a 31% performance improvement in predicting individual labels. The findings underscore the importance of perspectivism in subjective Natural Language Processing (NLP) tasks like identifying gender-based violence (GBV).

Introduction

In traditional NLP, researchers typically aggregate multiple annotator labels into a single "gold standard" ground truth. However, for subjective tasks like identifying GBV, sexism, or misogyny, this aggregation often erases the diverse perspectives of marginalized groups and ignores the ideological biases of the annotators themselves. While previous studies attempted to use demographic data (age, gender, ethnicity) to predict annotator behavior, demographics are often poor predictors of individual judgment. This research addresses the gap by examining social attitudes—psychological constructs that shape perceptions of social hierarchies—and exploring how these attitudes can be modeled to improve automated content moderation.

Methodology

The researchers adopted a "strongly perspectivist" approach, preserving individual labels rather than collapsing them into a majority vote. The methodology involved three main pillars:

  1. Psychological Profiling: 43 annotators were recruited and administered three validated Social Psychology surveys: Very Short Authoritarianism (VSA), Short Social Dominance Orientation (SSDO), and the Brief Hostile Neosexism Scale (BHNS).
  2. Statistical Modeling: A mixed-effects regression model quantified the relationship between these survey scores and the likelihood of an annotator labeling a text as "sexist."
  3. LLM Prompting & Fine-tuning: Several LLMs (FLAN-T5, Llama 2/3, and Mistral) were tested using various prompting strategies, including "annotator-infused" prompts that included the psychological profile of the target annotator.
Figure 1: Comparison between plain text annotation and the proposed annotator-infused approach, which incorporates demographic and attitudinal information to predict individual labels.

Datasets

The study re-annotated two prominent English-language datasets: EDOS (Explainable Detection of Sexism) and DOM (Detection of Online Misogyny). The authors collected up to 23 labels per item for 1,600 instances, creating a multi-perspective dataset that pairs text with detailed attitudinal profiles of the people who rated it.

Analysis of Annotator Attitudes

The statistical analysis revealed significant correlations between psychological traits and labeling behavior, confirming that attitudes are more robust predictors than demographics alone:

  • The RWA Paradox: Surprisingly, annotators with higher VSA (Right-Wing Authoritarianism) scores were more likely to label text as sexist. This may be linked to "benevolent sexism," where individuals seek to protect women who adhere to traditional roles.
  • Internalized Leniency: Conversely, those with high SSDO and BHNS (Neosexism) scores were significantly less likely to label items as sexist, likely viewing offensive text as natural or inevitable due to their belief in social hierarchies.
Figure 6: Regression analysis showing the statistical significance of various factors, including high scores in VSA, SSDO, and BHNS, on labeling behavior.

Experimental Results

  • Performance Gains: In-Context Learning (ICL) using annotator information improved performance by 17% to 26% over a majority-class baseline. Fine-tuning provided an even greater boost of 31%.
  • Model Sensitivity: LLMs proved highly sensitive to the "persona" provided in prompts; they successfully shifted classification boundaries to match the predicted bias of the described annotator.
  • Prompt Structure: Providing a well-structured, brief summary of attitudes (e.g., "This worker is moderate RWA...") was more effective than providing raw survey data, which tended to degrade performance.

Conclusion and Future Work

While the study demonstrates the power of attitudinal profiling, it is limited by a relatively small sample of 43 annotators and a focus on English-language internet forum data. Future research will expand into multilingual contexts and explore complex intersectional identities to further refine the taxonomy of gender-based violence in automated systems.

Summary updated

Abstract

Gender-Based Violence (GBV) is an increasing problem online, but existing datasets fail to capture the plurality of possible annotator perspectives or ensure the representation of affected groups. We revisit two important stages in the moderation pipeline for GBV: (1) manual data labelling; and (2) automated classification. For (1), we examine two datasets to investigate the relationship between annotator identities and attitudes and the responses they give to two GBV labelling tasks. To this end, we collect demographic and attitudinal information from crowd-sourced annotators using three validated surveys from Social Psychology. We find that higher Right Wing Authoritarianism scores are associated with a higher propensity to label text as sexist, while for Social Dominance Orientation and Neosexist Attitudes, higher scores are associated with a negative tendency to do so. For (2), we conduct classification experiments using Large Language Models and five prompting strategies, including infusing prompts with annotator information. We find: (i) annotator attitudes affect the ability of classifiers to predict their labels; (ii) including attitudinal information can boost performance when we use well-structured brief annotator descriptions; and (iii) models struggle to reflect the increased complexity and imbalanced classes of the new label sets.
BibTeX
@inproceedings{jiang2024re,
  author = {Aiqi Jiang and Nikolas Vitsakis and Tanvi Dinkar and Gavin Abercrombie and Ioannis Konstas},
  title = {{Re-examining Sexism and Misogyny Classification with Annotator Attitudes}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2024},
  doi = {10.18653/v1/2024.findings-emnlp.887},
}
Figure