Abstract
Conversational agents often struggle in high-stakes mental health contexts, frequently defaulting to generic, hollow responses or, in worse cases, providing dangerous advice. This paper introduces HEAL (Healing, Empathy, and Affect Learning), a large-scale knowledge graph designed to provide a structured, interpretable framework for distress management. By processing over 1 million social media narratives, HEAL maps stressors to user expectations and listener responses, categorized by 41 affective states. Experimental results demonstrate that a HEAL-based retrieval system significantly improves response diversity and safety compared to traditional "black-box" neural models.
Introduction
While AI chatbots are increasingly used for emotional support, existing end-to-end neural models (e.g., GPT-based agents) face two critical challenges: the "generic response trap" and significant safety risks. In distress management, a model that suggests harmful actions due to a lack of grounding can be catastrophic.
HEAL addresses these issues by providing a "fail-safe" knowledge graph (KG) that structures emotional reasoning. It links specific stressors (e.g., suicidal ideation) to what users expect (e.g., advice) and how listeners effectively respond (e.g., suggesting therapy), ensuring responses are grounded in historically positive interactions. By using a retrieval-based approach—finding the right node in the graph—rather than a generative one, the system gains a "safety rail."
Methods and Data Construction
The HEAL graph was constructed using a multi-stage pipeline to transform unstructured data from eight mental health-related subreddits (including r/mentalhealthsupport and r/suicidewatch) into a relational map.
The construction process involved several key steps:
- Summarization: Core distress "essences" were extracted from long Reddit posts using the SMMRY algorithm to handle the long-winded nature of social media narratives.
- Clustering: Sentence-BERT embeddings and agglomerative clustering identified approximately 4,000 unique stressors and 13,000 response types from a pool of 1 million dialogues.
- Affective Modeling: A BERT-based transformer classifier assigned nodes to one of 41 affective states (e.g., lonely, hopeful, apprehensive).
- Graph Assembly: The final KG contains 22,037 nodes and 104,004 connections, modeling the transition from distress to relief.
Key Results and Insights
Analysis of the graph revealed a clear "emotional trajectory." While 73.6% of stressors are associated with negative emotions, the feedback nodes show a massive 270% increase in neutral states and a 7% increase in positive states, providing a roadmap for how successful conversations move from distress to relief.
In comparative evaluations against state-of-the-art models like Blender and specialized empathetic generators:
- Diversity: HEAL-ranked responses significantly outperformed baselines in Distinct-N metrics, meaning the bot was much less likely to repeat hollow phrases like "I am sorry to hear that."
- Human Evaluation: In blind tests with Amazon Mechanical Turk workers, HEAL’s responses were rated as "Good" 61.19% of the time, compared to 51.75% for Blender.
- Safety: Qualitative case studies showed that while generative models occasionally gave dangerous advice (e.g., encouraging self-harm as a "joke"), HEAL consistently provided safe, grounding responses like "Don't do it" or "I'm sorry it's been so hard on you."
Conclusion and Future Work
HEAL demonstrates that structured knowledge can provide essential "safety rails" for empathetic AI. Future directions include expanding the graph's coverage beyond the current 4,000 stressors and developing more sophisticated re-ranking algorithms. Ultimately, the researchers aim to integrate HEAL into neural generation models as a "knowledge guardrail" to combine the conversational fluency of AI with the safety of a structured graph.
Summary updated