Adaboost with Auto-Evaluation for Conversational Models

Juncen Li, Ping Luo, Ganbin Zhou, Fen Lin, Cheng NiuIJCAI 2018 · DOI

Introduction

Conversational AI models often struggle with generating relevant and diverse responses. Two primary issues plague current systems: irrelevance, where responses are disconnected from the input, and the "safe response trap," where models over-rely on generic phrases like "I don't know" or "Okay." While ensemble methods like Adaboost have historically addressed similar issues in classification by focusing on "hard" examples, they are difficult to apply to dialogue because conversation lacks a binary "right or wrong" signal.

Researchers from Tencent and the Chinese Academy of Sciences have proposed AwE (Adaboost with Auto-Evaluation) to bridge this gap. By utilizing a GAN-inspired "auto-evaluator" to provide the necessary feedback signal, AwE iteratively improves conversational models, significantly reducing generic responses and enhancing human-like dialogue.

Methods: The AwE Framework

The AwE framework treats existing conversational models as "weak generators" and iteratively refines them through a boosting process.

The AwE architecture showing the Epoch module (a) and the overall ensemble process (b).

The Auto-Evaluator (AE)

The core innovation is the Auto-Evaluator, a GRU-based RNN classifier trained to distinguish between human-generated responses and bot-generated ones. This provides the "goodness" signal required by Adaboost.

If the AE correctly identifies a bot response as "fake," that instance is marked as "hard," and its weight is increased for the next training round. Conversely, if the AE is fooled (a false positive), the model is considered to have "passed." For inference, the ensemble uses a weighted beam search that combines predictions from all models based on their learned weights.

Experimental Setup

The study utilized a refined dataset from Tencent Weibo, consisting of 803,716 high-quality post-response pairs. The data was split into training (approximately 773k pairs), validation (29k pairs), and a test set of 1,000 posts. The vocabulary included 17,395 Chinese characters and high-frequency words.

Key Results and Insights

AwE was evaluated against standard Seq2Seq models and other ensemble methods like Bagging and Maximum Score selection.

Quantitative Performance

  • BLEU Scores: AwE achieved a BLEU-4 score of 4.27, outperforming the Seq2Seq baseline (3.85) and other ensemble methods.
  • Diversity: AwE successfully reduced high-frequency (generic) responses to 19.8%, whereas other ensemble methods often exceeded 27%.
  • Human Evaluation: On a 0-2 scale, AwE earned a mean score of 0.989, significantly higher than the baseline's 0.903.

Qualitative Comparison

The framework's ability to break the generic cycle is most evident in direct comparisons. While baseline models often default to "I don't know what you are talking about," AwE provides specific, contextually relevant answers.

Qualitative comparison of responses across different methods, highlighting AwE's ability to provide specific answers.

Discussion and Future Work

The primary insight of AwE is using a discriminator's failure as a success metric. By forcing subsequent models in the ensemble to focus on prompts where the previous models produced "fake-looking" responses, the system learns to generate more semantically rich content.

However, the authors note potential risks of overfitting if the number of iterations ($K$) is too high. Additionally, the computational cost of training multiple models and the dependency on the Auto-Evaluator's quality remain areas for future optimization. Future research may explore more sophisticated AE architectures to further stabilize the boosting signal.

Summary updated

BibTeX
@inproceedings{li2018adaboost,
  author = {Juncen Li and Ping Luo and Ganbin Zhou and Fen Lin and Cheng Niu},
  title = {{Adaboost with Auto-Evaluation for Conversational Models}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2018},
  doi = {10.24963/ijcai.2018/580},
}
Figure