FG 2025 TrustFAA: the First Workshop on Towards Trustworthy Facial Affect Analysis: Advancing Insights of Fairness, Explainability, and Safety (TrustFAA)

Jiaee Cheong, Yang Liu, Harold Soh, Hatice GunesarXiv 2025 · DOI · arXiv

Abstract

As Facial Affect Analysis (FAA) transitions from laboratory research to high-stakes real-world applications such as healthcare, autonomous driving, and human-robot interaction, the need for trustworthy systems becomes paramount. The FG 2025 TrustFAA Workshop represents the first dedicated forum focused on bridging the gap between standard machine learning and the unique ethical challenges of affective computing. This paper outlines the workshop's mission to formalize "Trustworthy FAA" through the lenses of fairness, explainability, and safety.

Introduction

Facial Affect Analysis (FAA)—the computational study of human emotions and expressions—is no longer a niche academic pursuit. It is increasingly integrated into social robotics, educational tools, and clinical diagnostic aids. However, as these systems move into the public sphere, they often operate as "black boxes," raising significant concerns regarding algorithmic bias, lack of transparency, and potential safety risks.

The TrustFAA workshop, held in conjunction with FG 2025, addresses these challenges head-on. By bringing together a multidisciplinary community of researchers, the workshop aims to establish a framework for FAA systems that are not only accurate but also ethically sound and socially responsible.

The Trustworthiness Gap in Affective Computing

While "Trustworthy Machine Learning" is an established field, its application to facial affect presents unique difficulties. Affective data is deeply personal, culturally dependent, and context-sensitive. Standard fairness techniques often fail to account for the nuances of macro- and micro-expressions or the causal complexities inherent in emotional states like depression or pain.

Existing literature frequently overlooks the specific safety implications of misinterpreting human affect. For instance, in a collaborative robot scenario, a failure to correctly identify a user's distress is not merely a classification error; it is a failure of social safety that could lead to physical or psychological harm. The workshop aims to bridge this gap by formalizing Trustworthy FAA as a critical sub-discipline.

Core Pillars of Trustworthy FAA

The workshop organizes the research landscape into three critical dimensions:

1. Fairness and Bias Mitigation

FAA systems have historically shown significant disparities in performance across different demographic groups, particularly regarding race and gender. The workshop encourages research into mitigating these biases, ensuring that emotion recognition is equitable across diverse populations and does not perpetuate existing societal prejudices.

2. Explainability and Transparency

For FAA to be useful in professional settings like healthcare or coaching, the "why" behind a system's decision is as important as the decision itself. The workshop focuses on developing user-centered interfaces that provide interpretable insights for non-experts, such as clinicians or educators, rather than just raw prediction scores.

3. Safety and Robustness

In dynamic, "in-the-wild" environments, FAA systems must handle uncertainty, occlusions, and varying lighting conditions. Robustness is a prerequisite for trust, especially when AI interpretations influence real-time human-machine interactions. This pillar focuses on ensuring systems remain reliable even in unpredictable settings.

Methodology: Building a Research Community

As a foundational workshop proposal, TrustFAA outlines a structured approach to community building:

  • Multidisciplinary Scope: Submissions cover a broad spectrum of tasks, including action unit detection, valence/arousal estimation, and pain/depression detection.
  • Ethical Impact Statements: In a move toward greater accountability, researchers are required to include statements considering the societal consequences of their technical work from the outset.
  • Expert Exchange: The forum facilitates dialogue between industry and academia, featuring invited talks from leaders in affective computing to identify current gaps in the literature.

High-Stakes Frontiers: Human-Robot Interaction (HRI)

A significant focal point of the workshop is the role of FAA in HRI. When robots are tasked with assisting humans, their ability to read and respond to affect is a core component of their functional safety. The organizers argue for a shift in the field's "North Star"—moving away from pure accuracy toward a holistic view that includes privacy-preserving de-identification technologies and intuitive usability for the end-user.

Conclusion and Future Directions

The FG 2025 TrustFAA Workshop marks a critical step toward standardizing trustworthy metrics in affective computing. Future work must address the cross-cultural nuances of emotional expression to avoid Western-centric biases and push for robustness in real-world deployments where lighting and movement make trust harder to maintain. By establishing a recurring venue for these discussions, the organizers hope to fill the current void in "gold standards" for what constitutes a safe and explainable FAA system.

Summary updated

Abstract

With the increasing prevalence and deployment of Emotion AI-powered facial affect analysis (FAA) tools, concerns about the trustworthiness of these systems have become more prominent. This first workshop on "Towards Trustworthy Facial Affect Analysis: Advancing Insights of Fairness, Explainability, and Safety (TrustFAA)" aims to bring together researchers who are investigating different challenges in relation to trustworthiness-such as interpretability, uncertainty, biases, and privacy-across various facial affect analysis tasks, including macro/ micro-expression recognition, facial action unit detection, other corresponding applications such as pain and depression detection, as well as human-robot interaction and collaboration. In alignment with FG2025's emphasis on ethics, as demonstrated by the inclusion of an Ethical Impact Statement requirement for this year's submissions, this workshop supports FG2025's efforts by encouraging research, discussion and dialogue on trustworthy FAA.
BibTeX
@misc{cheong2025fg,
  author = {Jiaee Cheong and Yang Liu and Harold Soh and Hatice Gunes},
  title = {{FG 2025 TrustFAA: the First Workshop on Towards Trustworthy Facial Affect Analysis: Advancing Insights of Fairness, Explainability, and Safety (TrustFAA)}},
  year = {2025},
  eprint = {2506.05095},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2506.05095},
}
Figure