Moral Judgments in Online Discourse are not Biased by Gender

Lorenzo Betti, Paolo Bajardi, Gianmarco De Francisci MoralesarXiv 2024 · DOI · arXiv

TL;DR

While raw data suggests men receive harsher moral judgments online, a new causal inference study reveals this isn't due to direct gender bias. By matching highly similar stories from Reddit's /r/AITA community, researchers found that the discrepancy is almost entirely explained by the different types of situations men and women choose to share.

What Problem Does This Paper Address?

Correlational studies frequently show that male protagonists in moral dilemmas are judged more harshly than females. However, correlation isn't causation. Does this reflect a deep-seated gender bias among online judges, or do men simply land themselves in—and choose to post about—more clear-cut violations of social norms?

Disentangling this is crucial for understanding human decision-making and ensuring that large language models (LLMs), which are heavily trained on internet data like Reddit, don't inherit and amplify false biases. The authors set out to isolate the direct causal effect of a protagonist's declared gender on the moral judgments they receive.

Methods

The authors constructed a causal framework to map out direct vs. mediated effects of gender on moral judgment.

Fig. 1: Causal graph encoding our hypotheses on the judgment mech- anism in /r/AITA. Given a submission, we assume that the type of situation experienced (“Experiencing a situation”) is influenced by the gender and age of the protagonist (“Gender” and “Age”). Then, these three elements all affect the likelihood that the protagonist shares this situation on /r/AITA (“Posting on /r/AITA). Finally, the moral judg- ment received (“Judgment”) is caused by the gender of the protagonist through two causal paths: directly, which reflects the first hypothesis, and mediated by the type of situation described in the submission, which refers to the second hypothesis. The dashed edge from “Gender” to “Judgment” is the causal effect we aim to measure.

To isolate the direct effect (the dashed line in Figure 1), they used Propensity Score Matching (PSM) with calipers to pair stories describing nearly identical situations but featuring different protagonist genders. They leveraged SBERT (all-mpnet-base-v2) to generate text embeddings for semantic similarity and trained a BERT model as a propensity scorer to predict the author's gender based on the text.

Crucially, they implemented a "gender neutralization" strategy during training—swapping gendered words like "wife" and "husband" with a 50% probability—to prevent the model from relying on lexical shortcuts. Latent Dirichlet Allocation (LDA) was used to cluster posts into six distinct topics to control for context. Finally, they calculated the Sample Average Treatment Effect on the Treated (SATT) across different semantic distance thresholds.

Datasets

The study utilized a massive scrape of the popular Reddit community /r/AITA (Am I The Asshole) spanning 2014 to 2020.

  • Raw Dataset: 250,770 submissions and over 6.8 million comments.
  • Core Analytical Dataset: 33,421 submissions that contained explicit, self-disclosed demographic tags (e.g., "M22", "F26") and received a clear community judgment (blame vs. no blame) weighted by comment scores.

Key Insights and Ideas

  • The "Situation" Mediates the Bias: The apparent harshness toward men is a reporting/behavioral artifact. The situation itself acts as a full mediator; men are simply more likely to share stories where they exhibit higher agency or engage in riskier behavior that violates social norms.
  • Context Matters: When broken down by topic, a small but statistically significant bias against men does persist in one specific domain: "friendship and relationships." This suggests gender roles and stereotypes exert a stronger influence in specific social contexts.
  • Loose Matches Confound Causal Claims: Human evaluation revealed that when semantic matching is too loose, the crude "male-blame" correlation leaks back in. Tight semantic constraints are mandatory for valid text-based causal inference.

Key Results

  • In the unadjusted dataset, men were roughly twice as likely as women to receive a negative judgment (Odds Ratio = 2.21).
  • After applying tight propensity score matching, the SATT dropped to near zero and lost statistical significance for closely matched pairs.
Fig. 2: Causal effect of the protagonist’s gender on moral judgment. (a) Sample average treatment effect on the treated (SATT) for different values of the maximum semantic distance. We report the SATT from maximum semantic distance equal to 0.20 because of the small amount of matches below this value (N < 120). (b) SATT for each topic corre- sponding to the matches obtained with maximum semantic distance equal to 0.25. Vertical bars correspond to bootstrap 95% confidence intervals.
  • As seen in Figure 2a, the overall SATT hovers around zero at low semantic distances but creeps upward as the matching threshold loosens (introducing lower-quality matches).
  • When stratified by topic (Figure 2b), only "friendship and relationship" showed a distinct, statistically significant positive SATT, indicating a negative bias toward men unique to that context.

Limitations and Future Work

The study is restricted to text-mediated, pseudonymous online interactions on a platform with a specific demographic skew (young, female, and US-dominated). It also assumes a homogeneous jury due to Reddit's anonymity constraints, meaning unobserved confounders like judge homophily (e.g., male judges being more lenient toward male authors) could not be fully controlled.

The authors suggest that future work should focus on scaling the measurement of protagonist agency to further validate why men and women choose to share different types of morally ambiguous stories.

Summary updated

Abstract

The interaction between social norms and gender roles prescribes gender-specific behaviors that influence moral judgments. Here, we study how moral judgments are biased by the gender of the protagonist of a story. Using data from r/AITA, a Reddit community with 17 million members who share first-hand experiences seeking community judgment on their behavior, we employ machine learning techniques to match stories describing similar situations that differ only by the protagonist's gender. We find no direct causal effect of the protagonist's gender on the received moral judgments, except for stories about ``friendship and relationships'', where male protagonists receive more negative judgments. Our findings complement existing correlational studies and suggest that gender roles may exert greater influence in specific social contexts. These results have implications for understanding sociological constructs and highlight potential biases in data used to train large language models.
BibTeX
@misc{betti2024moral,
  author = {Lorenzo Betti and Paolo Bajardi and Gianmarco De Francisci Morales},
  title = {{Moral Judgments in Online Discourse are not Biased by Gender}},
  year = {2024},
  eprint = {2408.12872},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2408.12872},
}
Figure