Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation

Leyang Cui, Yu Wu, Shujie Liu, Yue Zhang

Introduction: The "Frozen in Time" Problem

Large-scale pre-trained dialogue models, such as Facebook’s Blender, have demonstrated remarkable conversational abilities. However, they suffer from a significant limitation: they are "frozen in time." When a user mentions an "unseen entity"—a term, movie, or event that emerged after the model's training data was collected—the model lacks the semantic grounding to respond appropriately. For instance, a model trained in 2019 would have no inherent understanding of "COVID-19," often leading to nonsensical or insensitive responses.

The Challenge of Unseen Entities

Existing solutions typically rely on "Knowledge-Grounded" generation, where the system retrieves external information (e.g., from Wikipedia) to inform its response. While helpful, this approach is fragile. It fails if the entity is too new for the database, if the retrieval system selects irrelevant information due to polysemy, or if the system must operate in an offline environment with limited resources.

KE-Blender uses auxiliary tasks during training to handle unseen entities at inference time.

The authors of this paper propose a shift in perspective: instead of using external knowledge as a "crutch" during every conversation, why not use it as a "teacher" during the fine-tuning phase? This allows the model to learn how to infer the meaning of unknown words from their context, much like a human can deduce that "EMNLP" is a conference from the sentence "I am submitting a paper to EMNLP."

Methods: Knowledge Enhanced Fine-Tuning (KE-Blender)

The researchers introduce KE-Blender, a fine-tuning approach that incorporates external knowledge bases to create auxiliary training tasks. These tasks force the model to develop more robust semantic representations.

The multi-task fine-tuning framework of KE-Blender.

The model, based on the Blender-90M architecture, is trained on three simultaneous objectives:

  1. Dialogue Generation: The standard task of generating a relevant response to a user prompt.
  2. Interpret Masked Word: The model is presented with a sentence where a topic word is masked (e.g., "I submit a paper to the [MASK]"). It must then generate the definition of that masked word, sourced from Wikipedia. This teaches the model to associate specific linguistic contexts with entity types.
  3. Hypernym Generation: Using WordNet, the model learns to replace specific entities with their broader categories (hypernyms). For example, it learns to map "EMNLP" to "conference." This helps the model categorize unseen entities even without a precise definition.

Crucially, during inference (live use), the model does not require access to the external knowledge base. It relies entirely on the enhanced semantic understanding it internalized during the fine-tuning process.

Evaluation and Datasets

The effectiveness of KE-Blender was tested on two primary benchmarks:

  • Wizard of Wikipedia (WoW): Specifically the "Test Unseen" portion, featuring topics absent from the training set.
  • Reddit Trendings: A novel dataset created by the authors containing 407 dialogues on "hot topics" from 2021 (e.g., new tech, recent news) that were not present in older training corpora or Wikipedia versions.

Key Results and Insights

  • Superior Generalization: On the WoW "Test Unseen" set, KE-Blender achieved a Perplexity (PPL) of 18.4, significantly better than the standard Blender baseline's 19.9.
  • Reduced Performance Gap: The gap in quality between seen and unseen topics was narrowed to 2.9 PPL for KE-Blender, compared to 3.8 PPL for the baseline, demonstrating improved adaptability.
  • Robustness to Noise: Unlike traditional knowledge-grounded models that can be "distracted" by irrelevant retrieved snippets, KE-Blender remained stable and coherent even when external information was unavailable or incorrect.
  • Human Preference: Blind human evaluations rated KE-Blender's responses as more knowledgeable and coherent, particularly in scenarios where knowledge retrieval was impossible.

Conclusion and Future Directions

KE-Blender demonstrates that external knowledge is most powerful when used to "distill" understanding into a model's weights rather than just serving as an input. While the current approach relies on the quality of the training knowledge base, it provides a path toward more robust, context-aware AI. Future work may involve scaling these auxiliary tasks to multi-billion parameter models and exploring even more diverse "out-of-distribution" scenarios, such as specialized medical or technical domains.

Summary updated

Abstract

Although pre-training models have achieved great success in dialogue generation, their performance drops dramatically when the input contains an entity that does not appear in pre-training and fine-tuning datasets (unseen entity). To address this issue, existing methods leverage an external knowledge base to generate appropriate responses. In real-world scenario, the entity may not be included by the knowledge base or suffer from the precision of knowledge retrieval. To deal with this problem, instead of introducing knowledge base as the input, we force the model to learn a better semantic representation by predicting the information in the knowledge base, only based on the input context. Specifically, with the help of a knowledge base, we introduce two auxiliary training objectives: 1) Interpret Masked Word, which conjectures the meaning of the masked entity given the context; 2) Hypernym Generation, which predicts the hypernym of the entity based on the context. Experiment results on two dialogue corpus verify the effectiveness of our methods under both knowledge available and unavailable settings.
BibTeX
@inproceedings{cui2021knowledge,
  author = {Leyang Cui and Yu Wu and Shujie Liu and Yue Zhang},
  title = {{Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2021},
  doi = {10.18653/v1/2021.emnlp-main.179},
}
Figure