Towards a Formal Specification of Moral Emotions

Alexander Pankov, Mehdi DastaniESSEM@AAMAS 2015 · OpenReview

TL;DR

This paper proposes a semi-formal framework for specifying the elicitation conditions and coping strategies of three moral emotions: anger, contempt, and disgust. By integrating existing psychological theories with a dynamic, multi-agent BDI model, the authors aim to enable the creation of more socially aware AI agents and shed light on the rationality of moral emotions.

What Problem Does This Paper Address?

While there's been significant work in AI on modeling emotions, a precise, formal specification for moral emotions, particularly those directed at others' transgressions, has been lacking. Moral emotions are crucial for social behavior, guiding individuals to uphold internalized moral rules and promoting pro-social actions. Understanding and modeling these emotions is key to developing AI agents that can navigate complex social environments, learn from moral violations, and contribute to more ethical AI systems. This paper addresses this gap by providing a structured approach to formalizing anger, contempt, and disgust within a computational framework.

Methods

The authors propose a semi-formal specification based on appraisal theories of emotion and the CAD triad hypothesis. Their approach is rooted in a dynamic, multi-agent Belief-Desire-Intention (BDI) framework, which is standard for modeling intelligent agents. The novelty lies in how they integrate psychological theories of emotion elicitation and coping with this BDI architecture.

  • Appraisal Theories: Emotions are triggered by an agent's appraisal of events, specifically how these events relate to their goals and beliefs.
  • CAD Triad Hypothesis: This hypothesis links three moral emotions (contempt, anger, disgust) to violations of three moral codes (community, autonomy, divinity).
  • BDI Framework: Agents are modeled with beliefs about the world, desires (goals), and intentions (plans). Emotions are seen as states that influence these components.
  • Coping Strategies: The paper categorizes coping strategies into belief-affecting, goal-affecting, and intention-affecting, allowing for flexible modeling of how agents deal with emotional states.

The paper defines specific logical predicates to represent the appraisal conditions (e.g., blame, control, harm) and coping mechanisms for each of the three moral emotions.

Datasets

Not discussed in the paper.

Key Insights and Ideas

  • Formalizing Moral Emotions is Achievable: The paper demonstrates that it's possible to create a structured, semi-formal specification for complex moral emotions, moving beyond purely descriptive accounts.
  • Bridging Psychology and AI: The work effectively bridges cognitive psychology theories of emotion with computational agent modeling, offering a concrete example of interdisciplinary research.
  • Rationality of Moral Emotions: By formalizing the appraisal and coping processes, the paper suggests that moral emotions, far from being irrational, can be seen as rational responses that serve to uphold social norms and promote pro-social behavior.
  • Coping Strategies Drive Social Norms: The proposed coping mechanisms, particularly those aimed at sanctioning violators or reducing their social significance, highlight how emotions can indirectly reinforce the status of moral rules.
  • Distinction in Coping: The paper emphasizes the difference in coping strategies, with anger and disgust often leading to intention-affecting (action-oriented) responses, while contempt primarily involves belief-affecting strategies (changing perceptions of the other agent).

Key Results

The paper provides detailed semi-formal specifications for the elicitation conditions and coping strategies of anger, disgust, and contempt. These specifications are presented using logical predicates and are illustrated with examples, such as social media trolling, to demonstrate their applicability. The authors do not present empirical results or quantitative evaluations of their model but rather a conceptual framework.

Limitations and Future Work

The authors acknowledge several limitations and suggest future directions:

  • Semi-Formal Specification: The current specification is semi-formal, and a full logical formalization is a future goal.
  • Limited Emotion Set: The work focuses on only three moral emotions; extending the framework to include others is planned.
  • Simplified Coping: Aspects like "coping power" (resource availability) and "adjustment ability" (cost of changing goals) are not fully modeled.
  • Emotion Intensity: A mechanism for triggering coping strategies based on emotion intensity is missing.
  • Norm Representation: Moral rules are modeled simplistically; future work will involve representing their logical structure more robustly.
  • Real-World Scenarios: Further work is needed to implement and test these models in complex, real-world multi-agent environments.

Summary updated

BibTeX
@inproceedings{pankov2015towards,
  author = {Alexander Pankov and Mehdi Dastani},
  title = {{Towards a Formal Specification of Moral Emotions}},
  booktitle = {ESSEM@AAMAS},
  year = {2015},
  url = {https://openreview.net/forum?id=uabcbm6Jlz},
}
Figure