Task-Oriented Dialog Systems That Consider Multiple Appropriate Responses under the Same Context

Yichi Zhang, Zhijian Ou, Zhou Yu

Introduction: The One-to-Many Challenge

In natural human conversation, a single prompt often warrants multiple valid responses. For instance, if a user expresses hunger and asks for a place to eat in the city center, a helpful assistant might suggest a specific restaurant, ask for a preferred cuisine, or inquire about a price range. This inherent flexibility is known as the one-to-many property of dialogue.

The one-to-many property: a single user request can lead to multiple valid system actions and responses.

Traditional task-oriented dialog systems (TODS) typically fail to capture this diversity. Most models are trained to map a specific conversation context to a single "ground truth" response provided in a dataset. This approach leads to several issues:

  1. Data Bias: Datasets usually only record one of many possible valid responses for any given turn.
  2. Skewed Policies: Models tend to over-optimize for the most frequent actions, ignoring valid but less common alternatives.
  3. Lack of Diversity: The resulting bots often feel repetitive and "boring," lacking the adaptability required for real-world interactions.

Proposed Framework: MADA and DAMD

To address these limitations, this research introduces a novel framework consisting of Multi-Action Data Augmentation (MADA) and the Domain Aware Multi-Decoder (DAMD).

Multi-Action Data Augmentation (MADA)

MADA shifts the training paradigm from learning a single response to learning the entire set of valid actions for a given state. Instead of relying solely on the transcript's specific response, MADA scans the training corpus to identify all instances where a similar dialogue state (comprising conversation history, belief state, and database results) occurred. By aggregating the actions taken across these similar states, the framework creates a "state-to-actions" map. During training, the model is incentivized to learn this entire distribution, effectively de-biasing the dataset and encouraging diversity.

Domain Aware Multi-Decoder (DAMD)

The DAMD architecture implements this multi-action approach through an end-to-end neural network. It utilizes a single context encoder paired with three specialized decoders:

  • Belief Span Decoder: Tracks user constraints (e.g., "area=west").
  • Action Span Decoder: Determines the system's strategy (e.g., "inform" or "request").
  • Response Decoder: Generates the final natural language output.
The DAMD architecture and pipeline, showing how a single context leads to multiple decoded actions and corresponding natural language responses.

A key innovation within DAMD is Adaptive Delexicalization. By using generic placeholders (e.g., <v.name>) instead of domain-specific ones, the model can share knowledge across different tasks, such as applying booking logic from hotels to taxis.

Experimental Evaluation

The framework was evaluated on the MultiWOZ dataset, a complex multi-domain benchmark. The DAMD + MADA model achieved state-of-the-art results, reaching a combined score of 102.2, outperforming previous benchmarks like HDSA (99.5) and SFN+RL (93.7).

Beyond automated metrics, human evaluations confirmed the model's superiority in generating diverse and appropriate responses. On Likert scales, the augmented model significantly improved scores for Diversity (3.65 vs. 3.12) and Appropriateness (2.53 vs. 2.50) compared to baselines.

Conclusion

By explicitly modeling the one-to-many nature of dialogue through MADA and DAMD, this work provides a path toward more flexible and human-like task-oriented agents. While future work remains in addressing slot-level diversity and refining label quality, the shift toward structured, multi-action learning represents a significant advancement in dialogue system design.

Summary updated

Abstract

Conversations have an intrinsic one-to-many property, which means that multiple responses can be appropriate for the same dialog context. In task-oriented dialogs, this property leads to different valid dialog policies towards task completion. However, none of the existing task-oriented dialog generation approaches takes this property into account. We propose a Multi-Action Data Augmentation (MADA) framework to utilize the one-to-many property to generate diverse appropriate dialog responses. Specifically, we first use dialog states to summarize the dialog history, and then discover all possible mappings from every dialog state to its different valid system actions. During dialog system training, we enable the current dialog state to map to all valid system actions discovered in the previous process to create additional state-action pairs. By incorporating these additional pairs, the dialog policy learns a balanced action distribution, which further guides the dialog model to generate diverse responses. Experimental results show that the proposed framework consistently improves dialog policy diversity, and results in improved response diversity and appropriateness. Our model obtains state-of-the-art results on MultiWOZ.
BibTeX
@inproceedings{zhang2020task,
  author = {Yichi Zhang and Zhijian Ou and Zhou Yu},
  title = {{Task-Oriented Dialog Systems That Consider Multiple Appropriate Responses under the Same Context}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2020},
  doi = {10.1609/aaai.v34i05.6507},
}
Figure