Graph Based Network with Contextualized Representations of Turns in Dialogue

Bongseok Lee, Yong Suk Choi

TL;DR

This paper introduces TUCORE-GCN, a novel graph-based neural network designed to extract semantic relations from dialogues. It uniquely models dialogue context by considering speaker information, turn sequences, and argument interactions, achieving state-of-the-art results on dialogue-based relation extraction and demonstrating effectiveness in emotion recognition tasks by reframing it as a relation extraction problem.

What Problem Does This Paper Address?

Extracting semantic relations between entities in text is a well-studied problem. However, dialogues present unique challenges: high pronoun usage, low information density per turn, and relations that span multiple turns, making sentence-level extraction insufficient. Understanding dialogue requires grasping how speakers interact, the sequential nature of turns, and how arguments are referenced across these turns. Existing methods often struggle to capture this multi-turn, context-dependent information effectively.

Methods

The authors propose TUCORE-GCN (TUrn COntext awaRE Graph Convolutional Network), a model designed to address the complexities of dialogue-based relation extraction.

Here's a breakdown of its key components:

  • Encoding Module: Leverages BERT (or its variants like RoBERTa) to generate contextualized token representations. It incorporates speaker embeddings to explicitly model speaker changes, a crucial aspect of dialogue.
  • Turn Attention Module: Employs Masked Multi-Head Self-Attention with a "surrounding turn mask." This allows the model to attend to relevant information from adjacent turns, capturing the contextual flow of the conversation.
  • Dialogue Graph Construction: A heterogeneous graph is built with four node types (dialogue, turn, subject, object) and three edge types (dialogue, argument, speaker). This structure explicitly models interactions between turns, arguments, and speakers.
  • Sequential Information Injection: Before applying a Graph Convolutional Network (GCN) to the graph, turn nodes are passed through a Bidirectional LSTM (BiLSTM). This injects sequential information from the turns into the graph representation.
  • Classification Module: Concatenates features from the GCN layers to predict the relation between argument pairs.

A novel aspect is reframing Emotion Recognition in Conversations (ERC) as a dialogue-based relation extraction task. Here, an utterance's emotion is treated as a relation between the speaker and the utterance itself.

Datasets

The paper evaluates its model on:

  • DialogRE: A human-annotated dialogue-based relation extraction dataset.
  • ERC Datasets:
    • MELD: A multimodal dataset (textual modality used) from the TV show "Friends."
    • EmoryNLP: Another dataset collected from the TV show "Friends."
    • DailyDialog: A dataset reflecting daily communication, with anonymized speaker turns.

Key Insights and Ideas

  • Speaker Identity Matters: Explicitly modeling speaker information is crucial for accurately identifying relations in dialogues, as it influences how arguments are interpreted.
  • Context is King (and Sequential): Capturing the context from surrounding turns, not just the current one, significantly improves relation extraction performance. The sequential nature of dialogue turns is also vital.
  • Graph Representation for Dialogue: A heterogeneous graph effectively models the complex interplay between different elements (speakers, turns, arguments) in a dialogue.
  • ERC as Relation Extraction: Reframing emotion recognition as a relation extraction task offers a novel and effective approach, demonstrating the versatility of dialogue-based RE models.

Key Results

  • Dialogue-Based RE: TUCORE-GCN significantly outperforms existing state-of-the-art models on the DialogRE dataset, achieving new benchmark results. For instance, TUCORE-GCN ROBERTa achieved an F1 score of 73.1 and an F1c score of 65.9.
  • Emotion Recognition: The model also shows strong performance on MELD, EmoryNLP, and DailyDialog datasets, often outperforming previous state-of-the-art methods, particularly on MELD and EmoryNLP.
  • Asymmetric Relations: TUCORE-GCN shows improved performance on asymmetric inverse relations compared to BERT-based baselines, addressing a known limitation.

Limitations and Future Work

  • Limitations: The paper notes that while TUCORE-GCN performs well on DailyDialog, it shows slightly lower performance than CESTa, which uses a CRF layer that is well-suited for emotional consistency in adjacent utterances. This suggests that specific dialogue characteristics might benefit from specialized modeling.
  • Future Work: The authors suggest exploring the effectiveness of TUCORE-GCN on other dialogue-based natural language understanding tasks, indicating its potential for broader applications beyond relation extraction and emotion recognition.

Summary updated

Abstract

Dialogue-based relation extraction (RE) aims to extract relation(s) between two arguments that appear in a dialogue. Because dialogues have the characteristics of high personal pronoun occurrences and low information density, and since most relational facts in dialogues are not supported by any single sentence, dialogue-based relation extraction requires a comprehensive understanding of dialogue. In this paper, we propose the TUrn COntext awaRE Graph Convolutional Network (TUCORE-GCN) modeled by paying attention to the way people understand dialogues. In addition, we propose a novel approach which treats the task of emotion recognition in conversations (ERC) as a dialogue-based RE. Experiments on a dialogue-based RE dataset and three ERC datasets demonstrate that our model is very effective in various dialogue-based natural language understanding tasks. In these experiments, TUCORE-GCN outperforms the state-of-the-art models on most of the benchmark datasets. Our code is available at https://github.com/BlackNoodle/TUCORE-GCN.
BibTeX
@inproceedings{lee2021graph,
  author = {Bongseok Lee and Yong Suk Choi},
  title = {{Graph Based Network with Contextualized Representations of Turns in Dialogue}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2021},
  url = {https://openreview.net/forum?id=GzV9ZbJpJs},
}
Figure