ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human

Junfeng Tian, Hehong Chen, Guohai Xu, Ming Yan, Xing Gao, Jianhai Zhang, Chenliang Li, Jiayi Liu, Wenshen Xu, Haiyang Xu, Qi Qian, Wei Wang, Qinghao Ye, Jiejing Zhang, Ji Zhang 0011, Fei Huang, Jingren ZhouarXiv 2023 · DOI · arXiv

Introduction

In the pursuit of creating realistic "digital humans," researchers face a significant hurdle: balancing model scale with factual reliability and social intelligence. While large-scale language models (LLMs) demonstrate impressive capabilities, they often struggle with hallucinations, inconsistent personalities, and the computational overhead of multi-tasking. Alibaba’s DAMO Academy has introduced ChatPLUG, a Chinese open-domain dialogue system designed specifically for digital humans. ChatPLUG leverages a novel "internet-augmented instruction tuning" framework to bridge the gap between massive pre-training and real-world conversational utility.

The Challenge for Digital Humans

Applying standard LLMs to virtual avatars or assistants presents three primary challenges:

  1. Knowledge Hallucination: Models frequently generate outdated or fabricated facts with high confidence.
  2. Personality Inconsistency: Maintaining a stable "persona" over long-term interactions is difficult for general-purpose models.
  3. Multi-task Generalization: Training a single model to excel at empathetic support, factual retrieval, and role-playing simultaneously often leads to performance degradation in specific domains.

ChatPLUG addresses these by grounding responses in external reality and specific social constraints rather than relying solely on internal parameters.

Methodology: The ChatPLUG Pipeline

The ChatPLUG framework follows a structured three-step process to ensure efficiency and accuracy.

The three-step ChatPLUG pipeline: Large-scale Pre-training, Internet Knowledge Acquisition, and Internet-Augmented Instruction Tuning.

1. Two-Stage Pre-training

The model undergoes initial training on a 300GB document corpus (including Wikipedia and Common Crawl) to establish foundational knowledge. This is followed by a "curriculum learning" phase using multi-turn dialogue data, which refines the model's understanding of conversational flow.

2. Internet Knowledge Acquisition

To mitigate hallucinations, ChatPLUG incorporates a search module. A "query rewrite" component transforms conversation history into optimized search terms. The system then retrieves relevant snippets from the web to provide the model with up-to-date external information.

3. Internet-Augmented Instruction Tuning

The core innovation is the use of a Fusion-in-Decoder (FiD) architecture. Unlike standard models that concatenate all context into a single sequence, FiD encodes different information sources (history, persona, search results) independently. The decoder then fuses these representations. This parallel processing allows the model to handle extensive contexts—essential for digital humans—without the exponential computational costs of traditional serial processing.

Diverse Conversational Datasets

ChatPLUG was trained on a comprehensive mix of benchmarks and custom datasets to ensure a wide range of social skills:

  • LTD (Long-turn Dialogue): 30K+ sessions of high-quality, 12-turn conversations.
  • PCDD (Persona Consistency Dialogue): Designed to prevent self-contradiction in the bot's profile.
  • CED (Chinese Empathetic Dialogue): A new dataset focused on emotional support scenarios.
  • ChatEval500: A real-world evaluation set spanning eight categories, including Daily Chat and Open QA.
  • Existing Corpora: Integration of Weibo/Douban social data, DuReader-MRC for knowledge, and DuLeMon for persona-grounding.

Key Insights: Knowledge Offloading and Efficiency

A pivotal finding of the ChatPLUG research is the power of knowledge offloading. By delegating factual retrieval to a search engine, smaller models can achieve performance comparable to much larger counterparts.

Comparison of accuracy between Search and Non-Search models across different parameter scales.

As shown in the evaluation, a 240M parameter ChatPLUG equipped with internet search capabilities outperformed an 11B parameter model (PLATO-XL) that lacked such access. This demonstrates that architectural intelligence and external grounding can be more effective than raw parameter scaling.

Furthermore, by treating personality, empathy, and knowledge as distinct instructions within a unified format, ChatPLUG learns to toggle between these skills seamlessly. The FiD architecture also ensures that the 13B model remains highly efficient, achieving a 5x speedup via the "Allspark" acceleration engine and generating responses in as little as 0.25 seconds.

Results and Performance

ChatPLUG (3.7B and 13B) consistently outperformed competitors like PLATO-XL (11B) and EVA 2.0 (2.8B) on standard metrics such as ROUGE-L and BLEU-4. In human-bot interactive testing, ChatPLUG achieved a satisfaction score of 1.687/2.0, notably higher than ChatGLM’s 1.453.

Conclusion and Future Directions

While ChatPLUG represents a significant step forward, challenges remain in "self-chat" consistency and ensuring absolute safety in open-world internet retrieval. Future work will focus on deeper personalization and further latency optimization for real-time applications in gaming and virtual reality. By combining internet-augmented tuning with efficient architecture, ChatPLUG provides a robust "brain" for the next generation of digital humans.

Summary updated

Abstract

In this paper, we present ChatPLUG, a Chinese open-domain dialogue system for digital human applications that instruction finetunes on a wide range of dialogue tasks in a unified internet-augmented format. Different from other open-domain dialogue models that focus on large-scale pre-training and scaling up model size or dialogue corpus, we aim to build a powerful and practical dialogue system for digital human with diverse skills and good multi-task generalization by internet-augmented instruction tuning. To this end, we first conduct large-scale pre-training on both common document corpus and dialogue data with curriculum learning, so as to inject various world knowledge and dialogue abilities into ChatPLUG. Then, we collect a wide range of dialogue tasks spanning diverse features of knowledge, personality, multi-turn memory, and empathy, on which we further instruction tune \modelname via unified natural language instruction templates. External knowledge from an internet search is also used during instruction finetuning for alleviating the problem of knowledge hallucinations. We show that \modelname outperforms state-of-the-art Chinese dialogue systems on both automatic and human evaluation, and demonstrates strong multi-task generalization on a variety of text understanding and generation tasks. In addition, we deploy \modelname to real-world applications such as Smart Speaker and Instant Message applications with fast inference. Our models and code will be made publicly available on ModelScope: https://modelscope.cn/models/damo/ChatPLUG-3.7B and Github: https://github.com/X-PLUG/ChatPLUG .
BibTeX
@misc{tian2023chatplug,
  author = {Junfeng Tian and Hehong Chen and Guohai Xu and Ming Yan and Xing Gao and Jianhai Zhang and Chenliang Li and Jiayi Liu and Wenshen Xu and Haiyang Xu and Qi Qian and Wei Wang and Qinghao Ye and Jiejing Zhang and Ji Zhang and Fei Huang and Jingren Zhou},
  title = {{ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human}},
  year = {2023},
  eprint = {2304.07849},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2304.07849},
}
Figure