Assessing Cognitive Linguistic Influences in the Assignment of Blame

Karen Zhou, Ana Smith, Lillian LeeNAACL 2021

TL;DR

This paper investigates how linguistic cues, specifically the use of passive voice and thematic roles (agent/patient), influence blame assignment in online discussions. By analyzing a large dataset of Reddit posts, the study finds that while agent/patient framing aligns with existing theories, the passive voice hypothesis doesn't hold up empirically, suggesting a more nuanced understanding of how language shapes moral judgments.

What Problem Does This Paper Address?

The assignment of blame is a fundamental aspect of human social interaction and moral reasoning. Cognitive and linguistic theories propose that the way individuals describe events, particularly their own role in them, can significantly impact how others perceive their culpability. Specifically, dyadic morality theory suggests that perpetrators (agents) are seen as blameworthy, while victims (patients) are not. Furthermore, research has explored how using passive voice might shift responsibility, potentially making victims appear more culpable. However, these theories, largely developed in controlled lab settings, haven't been extensively tested on large-scale, naturally occurring online discourse. This paper aims to bridge this gap by examining whether these linguistic influences generalize to a real-world corpus of user-generated narratives about interpersonal conflicts.

Methods

The researchers employed a multi-faceted approach:

  • Passive Voice Identification: They used a dependency parser (spaCy) to identify passive subjects, specifically focusing on first-person passive subjects ("I" as the passive recipient of an action). This allowed them to quantify how often authors described themselves using passive constructions.
  • Thematic Role Identification: Semantic Role Labeling (SRL) was used to identify agents (ARGO) and patients (ARG1) within sentences. This helped categorize the author's role as either the actor or the recipient of an action. They also specifically tracked first-person agents and patients.
  • Statistical Analysis: To assess the significance of linguistic features, they used binomial tests, controlling for post length differences between verdicts.
  • Verdict Prediction Task: They built both linear (logistic regression) and non-linear (random forest) models to predict blame verdicts (YTA - You're the Asshole, NTA - Not The Asshole) using various feature sets, including word count, passive voice features, and SRL features. This allowed them to quantify the predictive power of these linguistic cues.

Datasets

The primary dataset used in this study is scraped from the subreddit r/AmItheAsshole (AITA). This corpus consists of over 22,000 user-submitted posts describing interpersonal conflicts, along with user comments and verdicts. The data was collected from November 2018 to April 2019. Posts with fewer than 20 comments or fewer than 6 words in the body were discarded to ensure meaningful content. For analysis, only YTA and NTA verdicts were considered, resulting in 22,795 posts. This dataset is related to the SCRUPLES dataset, also derived from the same subreddit, but the AITA corpus includes full comments for analysis.

Key Insights and Ideas

  • Agent/Patient Framing Matters: The study confirms that how authors frame themselves as agents or patients in their narratives significantly correlates with the blame they receive. This aligns with dyadic morality theory.
  • Passive Voice Hypothesis Questioned: Contrary to some lab findings, the use of first-person passive voice did not consistently lead to higher blame (YTA verdicts). In fact, NTA (not to blame) situations showed a higher rate of first-person passive subject usage. This suggests that in naturalistic online discourse, the passive voice might not function as a reliable indicator of culpability as previously theorized.
  • SRL Features are Predictive: Features derived from Semantic Role Labeling (identifying agents and patients) proved to be more predictive of blame verdicts than passive voice features alone, especially when combined with post length.
  • Context is Key: The authors acknowledge that their findings are specific to the r/AmItheAsshole forum, which may not be representative of all populations. They also highlight potential confounds like authors intentionally manipulating language or external factors influencing voter decisions.

Key Results

  • Passive Voice: NTA situations had a higher rate of first-person passive subject usage (45.8%) compared to YTA situations (37.4%).
  • Thematic Roles: YTA posts showed a significantly higher rate of first-person agent usage, while NTA posts had a significantly higher rate of first-person patient usage.
  • Prediction Task:
    • A linear model using Length+SRL features achieved a macro-average F1 score of 0.54.
  • A non-linear random forest model using Length+SRL features achieved a macro-average F1 score of 0.56.
  • These feature sets performed comparably to TF-IDF based lexical features but with significantly fewer features, suggesting the cognitive linguistic features are informative.

Limitations and Future Work

  • Passive Voice Noise: The authors suggest that passive voice features might have acted as "noise" in their prediction models, potentially due to the relatively low frequency of passive constructions or limitations in their extraction.
  • Sample Representativeness: The study acknowledges that the r/AmItheAsshole forum users might not be representative of the general population.
  • Intentional Manipulation: Authors might intentionally use certain linguistic strategies (like passive voice) to appear less guilty, which is difficult to disentangle from genuine linguistic patterns.
  • Future Directions:
    • Investigate other verdicts (e.g., "everyone is the asshole," "no one is the asshole").
  • Implement stricter length controls for analysis.
  • Validate SRL methodology more rigorously.
  • Group situations by topic to control for confounds.
  • Incorporate the range of votes from comments for more nuanced verdict prediction.
  • Explore how these findings can inform ethical AI development for more interpretable moral decision-making.

Summary updated

BibTeX
@inproceedings{zhou2021assessing,
  author = {Karen Zhou and Ana Smith and Lillian Lee},
  title = {{Assessing Cognitive Linguistic Influences in the Assignment of Blame}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2021},
}
Figure