Zero-Resource Knowledge-Grounded Dialogue Generation

Linxiao Li, Can Xu, Wei Wu, Yufan Zhao, Xueliang Zhao, Chongyang Tao

Introduction

To make conversational AI more engaging and informative, researchers rely on Knowledge-Grounded Dialogue (KGD), where responses are enriched by external documents like Wikipedia. However, training these models typically requires expensive, human-annotated "triples": a conversation context, a specific piece of knowledge, and a human-written response grounded in that knowledge.

Collecting these triples is a major bottleneck. It usually requires costly crowd-sourcing, and the resulting datasets are often small and domain-specific, leading to models that generalize poorly to new topics. This paper asks a critical question: Can we train a KGD model using only independent corpora—a pile of dialogues (e.g., from Reddit) and a pile of documents (e.g., from Wikipedia)—without any explicit links between them?

To solve this, the authors propose a "zero-resource" framework that eliminates the need for these expensive datasets. By treating knowledge selection and its expression as latent variables within a variational learning framework, the model achieves performance comparable to state-of-the-art supervised methods while demonstrating superior generalization to unseen topics.

Methods: The ZRKGC Framework

The authors introduce ZRKGC (Zero-Resource Knowledge-Grounded Conversation), which models the dialogue generation process using a probabilistic graphical model.

Graphical model of ZRKGC showing dependencies between context, latent variables, and response

The framework relies on two key latent variables:

  1. $Z_k$ (Latent Knowledge): Represents the specific external information that bridges the dialogue context and the generated response.
  2. $Z_\alpha$ (Grounding Rate): Controls how much of that knowledge is actually expressed in the response (e.g., a short acknowledgement versus a fact-heavy explanation).

Key Technical Innovations

  • Variational Approach (Generalized EM): Since the "true" knowledge used in a dialogue is unknown during training, the model uses an Expectation step to estimate the posterior distribution of the latent variables and a Maximization step to optimize the generation model.
  • Retrieval-based Posterior: Instead of using a complex generative model for the posterior (which is often slow and unstable), the authors use a retrieval model. This restricts the search space to a few relevant candidates, making the learning process much more stable.
  • Mutual Information (MI) Loss: To prevent "posterior collapse"—a common issue where the model simply ignores the latent variables—they add an MI loss to ensure a strong association between the grounding rate ($Z_\alpha$) and the generated response.
  • UNILM Backbone: The system is built on top of the Unified Language Model (UNILM), allowing it to leverage large-scale pre-training for fluent text generation.

Datasets and Evaluation

The model was trained on a combination of the Reddit Conversation Corpus (to learn dialogue flow) and a Wikipedia dump (for raw knowledge). Crucially, these datasets were entirely unpaired.

To evaluate its effectiveness, ZRKGC was tested on three major KGD benchmarks: Wizard of Wikipedia (Wizard), Topical-Chat (TC), and CMU Document Grounded Conversations (CMU_DoG). The goal was to see how well it compared to models trained with the specific, paired resources of those datasets.

Key Results and Insights

F1 scores of ZRKGC compared to baselines across multiple datasets
  • Competitive Performance & Generalization: On the "Wizard Unseen" test set, ZRKGC achieved an F1 score of 18.6, outperforming several supervised baselines and matching the performance of low-resource state-of-the-art models.
  • Robustness Across Domains: Supervised models often overfit to the specific style of crowd-workers, showing significant performance drops when transferred between different benchmarks. Because ZRKGC learns from broader, independent data, it remained remarkably stable across all three datasets (as seen in the chart above).
  • Controllability: By varying the latent $Z_\alpha$, users can theoretically control how "knowledgeable" the bot's response should be, offering a dial for response density.
  • Human Evaluation: In blind tests, humans rated ZRKGC higher in fluency and coherence than leading low-resource baselines, likely due to its effective use of the pre-trained UNILM backbone.

Limitations and Future Work

While highly fluent, the model still faces challenges common to the field, such as perfectly weaving complex facts into natural conversation (human scores for "Knowledge Relevance" remain lower than fluency scores). Additionally, the model is limited by the maximum input length of the transformer architecture. Finally, because highly informative responses are relatively rare in natural dialogue training sets like Reddit, the model performs less reliably when forced to use a very high grounding rate ($Z_\alpha > 0.5$). Future work will likely focus on better integrating long-form documents and improving high-density fact generation.

Summary updated

Abstract

While neural conversation models have shown great potentials towards generating informative and engaging responses via introducing external knowledge, learning such a model often requires knowledge-grounded dialogues that are difficult to obtain. To overcome the data challenge and reduce the cost of building a knowledge-grounded dialogue system, we explore the problem under a zero-resource setting by assuming no context-knowledge-response triples are needed for training. To this end, we propose representing the knowledge that bridges a context and a response and the way that the knowledge is expressed as latent variables, and devise a variational approach that can effectively estimate a generation model from independent dialogue corpora and knowledge corpora. Evaluation results on three benchmarks of knowledge-grounded dialogue generation indicate that our model can achieve comparable performance with state-of-the-art methods that rely on knowledge-grounded dialogues for training, and exhibits a good generalization ability over different datasets.
BibTeX
@inproceedings{li2020zero,
  author = {Linxiao Li and Can Xu and Wei Wu and Yufan Zhao and Xueliang Zhao and Chongyang Tao},
  title = {{Zero-Resource Knowledge-Grounded Dialogue Generation}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2020},
  url = {https://openreview.net/forum?id=dAmcGZT1Z2m},
}
Figure