Is ChatGPT Equipped with Emotional Dialogue Capabilities?

Weixiang Zhao, Yanyan Zhao, Xin Lu, Shilong Wang, Yanpeng Tong, Bing QinarXiv 2023 · DOI · arXiv

Introduction

The "holy grail" of conversational AI is the ability to recognize, understand, and respond to human emotions—a field known as Emotional Dialogue. While Large Language Models (LLMs) like ChatGPT have mastered the mechanics of language, their ability to navigate the underlying emotional context remains a subject of intense research. This study evaluates whether ChatGPT (specifically gpt-3.5-turbo) possesses the "emotional intelligence" required for human-like dialogue across two primary dimensions: Understanding Capability and Generation Capability.

The framework for evaluating Emotional Dialogue Capability, divided into Understanding and Generation tasks.

Evaluation Framework

The researchers benchmarked ChatGPT against various State-of-the-Art (SOTA) supervised models fine-tuned on specific emotional datasets. ChatGPT was tested in zero-shot and few-shot settings across five core tasks:

  1. Emotion Recognition in Conversations (ERC): Categorizing the emotion of every utterance.
  2. Emotion Cause Recognition (CEE): Identifying the specific statement that triggered an emotion.
  3. Dialogue Act Classification (DAC): Labeling the intent (e.g., "directive" or "suggestion").
  4. Empathetic Response Generation: Creating responses that demonstrate understanding.
  5. Emotional Support Conversation (ESC): Guiding users through negative emotional states using strategies like "reflection of feelings."

The study utilized gold-standard benchmarks including IEMOCAP, MELD, EmoryNLP, DailyDialog, RECCON-DD, EMPATHETICDIALOGUES, and ESCONV.

The Understanding vs. Generation Dichotomy

A striking finding of the study is the dichotomy between ChatGPT's ability to label emotions and its ability to generate them.

The "Annotation Gap" in Understanding

In tasks requiring precise labeling, such as Emotion Recognition (ERC), ChatGPT lagged behind fine-tuned SOTA models by 3 to 18 percentage points. However, the authors argue that these "errors" often stem from a mismatch in standards. For example, while a dataset might label a patient's description of a headache as "Neutral," ChatGPT often labels it "Sadness." In many cases, ChatGPT’s interpretation is more aligned with human intuition than the rigid, sometimes noisy, labels of the original datasets.

An example of an emotional dialogue between two individuals, illustrating the complexity of labeling emotions like frustration and anger in context.

Superiority in Generation

Despite its lower scores in labeling (the "theorist" role), ChatGPT excels as a "practitioner." In the Empathetic Response task, human evaluators preferred ChatGPT over SOTA models by a significant margin, citing higher Informativeness (78.67% win rate) and Empathy (54.33% win rate). ChatGPT produces longer, more diverse responses that feel more human, even if they score lower on automatic metrics like BLEU, which penalize word-overlap deviations from a single "ground truth."

The "Advice Trap" in Emotional Support

In Emotional Support (ESC) tasks, ChatGPT demonstrated a tendency to jump straight to "Providing Suggestions"—the final stage of support—while skipping crucial earlier stages like "Exploring" and "Comforting." While its responses were fluent and identified problems well, it occasionally lost to specialized models in empathy because it was too focused on solutions rather than "sitting with" the user's feelings.

Conclusion

ChatGPT represents a significant step toward emotionally intelligent AI. While it may not yet match specialized models in the technical task of emotion labeling, its generative capabilities are highly preferred by humans. Future research should focus on refining support strategies—teaching LLMs to provide comfort before solutions—and developing evaluation metrics that better align with human emotional perception rather than simple word overlap.

Summary updated

Abstract

This report presents a study on the emotional dialogue capability of ChatGPT, an advanced language model developed by OpenAI. The study evaluates the performance of ChatGPT on emotional dialogue understanding and generation through a series of experiments on several downstream tasks. Our findings indicate that while ChatGPT's performance on emotional dialogue understanding may still lag behind that of supervised models, it exhibits promising results in generating emotional responses. Furthermore, the study suggests potential avenues for future research directions.
BibTeX
@misc{zhao2023is,
  author = {Weixiang Zhao and Yanyan Zhao and Xin Lu and Shilong Wang and Yanpeng Tong and Bing Qin},
  title = {{Is ChatGPT Equipped with Emotional Dialogue Capabilities?}},
  year = {2023},
  eprint = {2304.09582},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2304.09582},
}
Figure