Massive Styles Transfer with Limited Labeled Data

Hongyu Zang, Xiaojun WanarXiv 2019 · arXiv

Introduction

Language style transfer—rewriting text to match a specific persona, formality level, or author's voice while preserving original meaning—typically requires massive amounts of parallel (labeled) data. In real-world scenarios, we often need to transfer a single source text into multiple different styles, but parallel data across all these styles is rarely available.

Previous approaches often treat each style pair as an isolated task or attempt standard multi-task learning by sharing model parameters. However, parameter sharing can actually hurt performance in style transfer because distinct target styles may conflict, leading to "target inconsistency." This paper introduces a Multi-Agent Style Transfer (MAST) system that leverages mutual similarities between styles to train highly accurate systems with minimal labeled data.

Methodology

The authors propose a framework that moves away from multi-task parameter sharing toward a collaborative multi-agent approach.

  1. Semi-Supervised Base Models: Individual one-to-one style transfer models are built using an Attentional Sequence-to-Sequence (AttS2S) architecture. These are enhanced with unlabeled data via Denoising Auto-Encoders (DAE) and Back-translation.
  2. Multi-Agent Style Transfer (MAST): Each pre-trained model is treated as an "agent." During text generation, these agents collaborate to predict the next word.
  3. Self-Organization by Similarities (SOS): Agents select "neighbor" agents based on target style similarity (measured via a binary classifier) and individual performance (BLEU scores).
  4. Multi-Agent Training (MAT): A lightweight RNN Controller is trained for each agent to dynamically predict a weight distribution over the agent and its neighbors, combining their vocabulary probability distributions.
The Multi-Agent Style Transfer (MAST) framework architecture.

Experimental Evaluation

The system was tested using 15 different English translations of the Bible, with the American Standard Version (ASV) as the source. To simulate data scarcity, labeled data was restricted to just 2,000 aligned sentence pairs per style, alongside 20,000 unaligned sentences for unlabeled training.

Key Results and Insights

The MAST system demonstrated significant improvements over all baselines. On a 5-target task, the MAST:SOS-2 configuration achieved an average BLEU score of 29.84, outperforming the vanilla AttS2S baseline (23.27) and the standard multi-task learning approach (MulT, 24.96).

Comparison of BLEU scores across different models and target styles.

Key Takeaways:

  • Collaboration Over Sharing: Treating models as independent agents that "vote" on the next word effectively bypasses the multi-task learning bottleneck, allowing models to remain specialized while benefiting from peer knowledge.
  • Selective Listening: The success of the system relies heavily on the SOS algorithm. Collaborating with randomly selected neighbors (MAST:Rand-k) proved unstable, highlighting the importance of selecting neighbors with similar styles and high accuracy.
  • Scalability and Robustness: Performance continued to improve as the pool of target styles grew from 5 to 15, as agents could find better matches. Furthermore, the system remained robust even when labeled data was reduced to only 500 parallel sentences.

Conclusion and Future Work

MAST provides a scalable and effective framework for multi-style transfer under low-resource conditions. While highly effective, the system is sensitive to neighbor selection. Future work will explore more advanced algorithms for identifying helpful neighbors and investigate alternative architectures for the Controller network to further push the performance ceiling.

Summary updated

Abstract

Language style transfer has attracted more and more attention in the past few years. Recent researches focus on improving neural models targeting at transferring from one style to the other with labeled data. However, transferring across multiple styles is often very useful in real-life applications. Previous researches of language style transfer have two main deficiencies: dependency on massive labeled data and neglect of mutual influence among different style transfer tasks. In this paper, we propose a multi-agent style transfer system (MAST) for addressing multiple style transfer tasks with limited labeled data, by leveraging abundant unlabeled data and the mutual benefit among the multiple styles. A style transfer agent in our system not only learns from unlabeled data by using techniques like denoising auto-encoder and back-translation, but also learns to cooperate with other style transfer agents in a self-organization manner. We conduct our experiments by simulating a set of real-world style transfer tasks with multiple versions of the Bible. Our model significantly outperforms the other competitive methods. Extensive results and analysis further verify the efficacy of our proposed system.
BibTeX
@misc{zang2019massive,
  author = {Hongyu Zang and Xiaojun Wan},
  title = {{Massive Styles Transfer with Limited Labeled Data}},
  year = {2019},
  eprint = {1906.00580},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1906.00580},
}
Figure