Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder

Bin Sun, Shaoxiong Feng, Yiwei Li, Weichao Wang, Fei Mi, Yitong Li, Kan Li

Abstract

In open-domain dialogue systems, Complex Dialogue Mappings (CDM)—comprising one-to-many and many-to-one relationships—often lead to incoherent or repetitive responses. Traditional approaches frequently attempt to bypass these complexities by filtering data or incorporating external knowledge, which can limit the model's understanding of natural human conversation. This paper introduces SegCVAE (Sentence Semantic Segmentation guided Conditional Variational Auto-Encoder), a framework designed to explicitly model and leverage CDM. By segmenting context into multiple "prominent semantics," SegCVAE addresses incoherence in one-to-many mappings and lack of diversity in many-to-one mappings. Experimental results across multiple datasets demonstrate that SegCVAE achieves state-of-the-art performance in both automatic and human evaluations.

Introduction

Human conversation is inherently non-linear. A single prompt can elicit a vast array of valid responses (one-to-many), while many distinct prompts might converge on a single, often generic, reply (many-to-one). These patterns, known as Complex Dialogue Mappings (CDM), pose a significant challenge for neural dialogue models. Standard models often struggle with "blended" responses—where the model attempts to average multiple valid replies into an incoherent whole—or "dull response" syndrome, where the model defaults to safe, high-probability phrases like "I don't know."

While previous research has focused on avoiding CDM through data manipulation or external information, this work posits that CDM data contains essential semantic relationships. SegCVAE is proposed to embrace these mappings by breaking down sentences into distinct semantic segments, allowing the model to navigate the diverse landscape of potential responses more effectively.

Methodology: The SegCVAE Framework

The core of SegCVAE is the use of sentence semantic segmentation to guide a Conditional Variational Auto-Encoder (CVAE). This approach ensures that the latent variables, which drive response generation, are grounded in specific, interpretable semantic components of the input.

1. Internal Separation (IS)

The Internal Separation module utilizes multiple "trigger" networks, implemented as Convolutional Neural Networks (CNNs), to extract different semantic segments from the input context. Each trigger identifies a unique "angle" or meaning within the sentence, effectively decomposing a complex prompt into its constituent parts.

2. External Guidance (EG)

To ensure these segments remain linguistically meaningful, the External Guidance module constrains the extracted semantics using the broader vocabulary. This prevents the model from developing internal representations that are disconnected from real-world language usage.

3. Semantic Norms

To optimize the segmentation and mapping process, the authors introduce three novel loss functions:

  • Alienation Norm: This forces the different semantic segments to be distinct from one another, preventing redundancy and encouraging the model to explore diverse response paths.
  • Centralization Norm: This ensures that the aggregate of all semantic segments accurately reconstructs the original context, maintaining the overall coherence of the dialogue.
  • Distillation Norm: This leverages the relationship between the input and the ground-truth response during training, teaching the model which specific semantic segments are most relevant to particular types of replies.

4. The Gradient Blocking Trick

A key technical innovation in training SegCVAE is the "Gradient Blocking Trick." During the training phase, the model identifies the semantic segment most relevant to the actual ground-truth response. Only this "best" segment is used to update the model's parameters for that specific instance. This prevents interference between different segments and allows each "trigger" to specialize in specific semantic niches.

Experimental Setup

The model was evaluated on two primary datasets: CornellMovie and Opensubtitles. To specifically test the model's ability to handle complex mappings, the researchers derived two specialized subsets from Opensubtitles:

  • O2M (One-to-Many): Focused on prompts with high response variety.
  • M2O (Many-to-One): Focused on scenarios where multiple prompts lead to similar responses.

Results and Discussion

SegCVAE demonstrated superior performance across a range of metrics compared to baselines such as standard CVAE and SpaceFusion.

Automatic Metrics

The model achieved state-of-the-art results in:

  • BLEU: Indicating higher word-level overlap with ground-truth responses.
  • Embedding Average: Showing stronger semantic similarity to human-generated replies.
  • Coherence: Measuring the logical flow between the prompt and the generated response.

Human Evaluation

In blind human assessments, SegCVAE was consistently ranked as the most Diverse and Relevant model. Unlike previous models that might sacrifice relevance for diversity (or vice versa), SegCVAE managed to improve both simultaneously by accurately modeling the underlying semantic structure of the conversation.

CDM Handling

On the O2M and M2O subsets, SegCVAE outperformed "knowledge-guided" models. It showed a unique ability to generate multiple, distinct, and highly relevant responses for a single prompt, effectively solving the "blended response" problem.

Conclusion

SegCVAE represents a shift in dialogue modeling by treating Complex Dialogue Mappings as a valuable feature rather than noise. By employing sentence semantic segmentation and specialized semantic norms, the model creates a more interpretable and effective latent space. While future work remains to be done on dynamically determining the number of semantic segments and improving the interpretability of the External Guidance module, SegCVAE sets a new benchmark for generating diverse and coherent human-like dialogue.

Summary updated

Abstract

Complex dialogue mappings (CDM), including one-to-many and many-to-one mappings, tend to make dialogue models generate incoherent or dull responses, and modeling these mappings remains a huge challenge for neural dialogue systems. To alleviate these problems, methods like introducing external information, reconstructing the optimization function, and manipulating data samples are proposed, while they primarily focus on avoiding training with CDM, inevitably weakening the model's ability of understanding CDM in human conversations and limiting further improvements in model performance. This paper proposes a Sentence Semantic \textbf{Seg}mentation guided \textbf{C}onditional \textbf{V}ariational \textbf{A}uto-\textbf{E}ncoder (SegCVAE) method which can model and take advantages of the CDM data. Specifically, to tackle the incoherent problem caused by one-to-many, SegCVAE uses response-related prominent semantics to constrained the latent variable. To mitigate the non-diverse problem brought by many-to-one, SegCVAE segments multiple prominent semantics to enrich the latent variables. Three novel components, Internal Separation, External Guidance, and Semantic Norms, are proposed to achieve SegCVAE. On dialogue generation tasks, both the automatic and human evaluation results show that SegCVAE achieves new state-of-the-art performance.
BibTeX
@inproceedings{sun2022modeling,
  author = {Bin Sun and Shaoxiong Feng and Yiwei Li and Weichao Wang and Fei Mi and Yitong Li and Kan Li},
  title = {{Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2022},
  url = {https://openreview.net/forum?id=fVKZ3576uGb},
}
Figure