Towards Unsupervised Language Understanding and Generation by Joint Dual Learning

Shang-Yu Su, Chao-Wei Huang, Yun-Nung Chen

Abstract

Shang-Yu Su, Chao-Wei Huang, Yun-Nung Chen. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.

This paper explores a fundamental symmetry in dialogue systems: the relationship between understanding what a user says and generating a response. By treating these as dual tasks and training them jointly, the authors demonstrate significant performance gains for both Natural Language Understanding (NLU) and Natural Language Generation (NLG).

Introduction

In traditional modular dialogue systems, NLU and NLG are treated as isolated silos. NLU's job is to map a sentence to a semantic frame (e.g., "Find a cheap Italian place" $\rightarrow$ intent: find_restaurant, price: cheap, cuisine: italian). NLG does the exact opposite, turning a semantic frame back into a natural sentence.

The challenge is that these modules are typically trained independently using supervised learning, which requires massive amounts of expensive, human-labeled pairs of utterances and semantic frames. Furthermore, training them separately ignores the "structural duality" between them—the fact that if you translate a concept into a sentence and then translate that sentence back into a concept, you should end up exactly where you started.

Methodology: Joint Dual Learning

The researchers propose a joint dual learning framework that treats NLU and NLG as two sides of the same coin. By "closing the loop"—transforming semantics to text and back again—the system can self-correct and learn more effectively, even paving the way for unsupervised learning in dialogue components.

The Joint Dual Learning framework consists of a Primal Cycle (Semantics to Text to Semantics) and a Dual Cycle (Text to Semantics to Text).

The framework consists of two main cycles:

  1. Primal Cycle: Semantics $\rightarrow$ NLG $\rightarrow$ NLU $\rightarrow$ Semantics.
  2. Dual Cycle: Utterance $\rightarrow$ NLU $\rightarrow$ NLG $\rightarrow$ Utterance.

Technical Innovations

A major hurdle in joint training is that NLG usually outputs discrete words (via an argmax operation), which breaks the gradient flow needed for backpropagation. The authors use a Straight-Through (ST) Estimator to bypass this, allowing gradients to flow through the discrete choices.

Additionally, the framework is "agnostic" to learning objectives, combining standard supervised cross-entropy loss with Reinforcement Learning (REINFORCE). To guide the RL agent, they utilize both explicit rewards (reconstruction likelihood, BLEU, F1) and implicit rewards (Language Models for fluency and MADE for semantic plausibility).

Experimental Results

The models were evaluated on the E2E NLG Challenge dataset, a collection of 50,000 instances in the restaurant domain. Each instance is a pair consisting of a semantic frame (containing slots like name, food, priceRange) and a corresponding natural language utterance.

Quantitative results comparing various learning schemes. The joint approach (f-l) consistently outperforms the supervised baseline (a).

As shown in the results table, the joint approach outperformed the standard iterative supervised baseline across the board:

  • NLU Performance: The Micro-F1 score jumped from 71.14% (baseline) to a peak of 81.52% when using the joint framework with implicit rewards (MADE).
  • NLG Performance: Generation quality improved as well, with BLEU scores rising from 55.05 to 57.59 in the best-performing hybrid configuration.

Key Insights

  • The "Perfect Cycle" as a Regularizer: The core insight is that the mathematical condition $g(f(x)) \equiv x$ acts as a powerful constraint. If the NLG produces a hallucination or misses a slot, the NLU will fail to reconstruct the original frame, creating a training signal.
  • Continuous Distribution as Data Augmentation: Feeding the continuous distribution of predicted labels from one module to the next (rather than just the single best "hard" label) significantly boosted NLU performance. This acts as a form of data augmentation, providing richer gradient signals.
  • Flexibility for Unsupervised Learning: Because the framework relies on cycles, it can theoretically learn from unpaired data. One could feed the system raw text (Dual Cycle) or raw semantic frames (Primal Cycle) and use the reconstruction loss to train the models without human labels.

Conclusion

While the joint dual learning framework demonstrates significant improvements in both understanding and generation, the authors note that fully unsupervised learning remains "unstable and hard to optimize." Future directions include incorporating large-scale pretrained models like BERT or GPT and investigating adversarial learning to further improve the naturalness of generated responses.

Summary updated

BibTeX
@inproceedings{su2020towards,
  author = {Shang-Yu Su and Chao-Wei Huang and Yun-Nung Chen},
  title = {{Towards Unsupervised Language Understanding and Generation by Joint Dual Learning}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2020},
  url = {https://openreview.net/forum?id=Hj9OXnoRKr},
}
Figure