Multi-Target Machine Translation with Multi-Synchronous Context-free Grammars

Graham Neubig, Philip Arthur, Kevin Duh

In the realm of Statistical Machine Translation (SMT), the standard approach involves translating from a single source language to a single target language. However, many real-world scenarios—such as United Nations proceedings or multilingual subtitles—require translating the same content into multiple languages simultaneously. A research team led by Graham Neubig (NAACL 2015) proposed a novel framework to exploit this redundancy: Multi-Synchronous Context-free Grammars (MSCFGs). By translating into two or more languages at once, the system can use a "strong" language model from a well-resourced language to disambiguate and improve the translation of a "weak" or low-resource language.

The Challenge of Cross-Lingual Disambiguation

The primary motivation for multi-target translation is that different languages provide different clues about the intended meaning of a source sentence. If a word in the source language is ambiguous, its translations in two different target languages might resolve that ambiguity. For instance, a specific choice in the primary target language might be grammatically plausible but lead to a nonsensical translation in the secondary target language.

Figure 1: An illustration of how a secondary target language can help disambiguate translation choices for a primary target language. In this example, the English "Kyoto Protocol" helps select the correct Chinese equivalent from an Arabic source.

As shown in Figure 1, a source phrase might have several candidate translations. By considering the "naturalness" of the corresponding translation in a second target language, the system can more accurately select the correct term in the first.

Methodology: Multi-Synchronous Context-free Grammars

The core of this approach is the MSCFG, which extends standard synchronous grammars. While a standard grammar maps a source rule to one target rule, an MSCFG maps a source rule to $N$ target rules simultaneously.

Rules are extracted by performing independent bilingual alignments between the source and each target language, then taking the cross-product of these alignments. To manage the increased computational complexity, the researchers explored two search strategies:

  • Joint Search: Expanding language model states for all target languages concurrently.
  • Sequential Search: Generating candidates for the primary target language first, then re-scoring them using the secondary language model.

Experimental Results

The researchers evaluated their system using the MultiUN corpus, simulating various resource scenarios. They compared a standard single-target system against their multi-target system (+LM2) which utilized a large language model for the secondary target.

Figure 4: BLEU scores for various language pairs as the amount of training data increases. The benefit of the secondary language model (+LM2) is most pronounced for linguistically related pairs like French and Spanish (en-fr/es).

Key Findings

  • Significant BLEU Gains: The multi-target system consistently outperformed single-target baselines. The most significant improvement was a 1.46 BLEU point gain for English $\to$ French/Spanish.
  • Language Similarity: The technique is highly effective when target languages are linguistically related (e.g., Romance languages). As seen in Figure 4, the gains for English $\to$ French/Spanish are substantial, whereas the gains for English $\to$ French/Chinese (en-fr/zh) are negligible due to structural differences.
  • Resource Sensitivity: The "help" from the secondary language is most critical when the primary language model is weak. As the amount of training data for the primary language increases, the relative benefit of the multi-target approach diminishes.

Conclusion and Future Work

This work demonstrates that "two heads are better than one" in machine translation. By leveraging multilingual data, MSCFGs provide a robust way to improve translation quality, especially for low-resource languages paired with high-resource ones. Future research may focus on relaxing the requirement for perfectly parallel N-way data and exploring joint alignment techniques to further refine the multilingual grammar rules.

Summary updated

Abstract

We propose a method for simultaneously translating from a single source language to multiple target languages T1, T2, etc. The motivation behind this method is that if we only have a weak language model for T1 and translations in T1 and T2 are associated, we can use the information from a strong language model over T2 to disambiguate the translations in T1, providing better translation results. As a specific framework to realize multi-target translation, we expand the formalism of synchronous context-free grammars to handle multiple targets, and describe methods for rule extraction, scoring, pruning, and search with these models. Experiments find that multi-target translation with a strong language model in a similar second target language can provide gains of up to 0.8-1.5 BLEU points. 1
BibTeX
@inproceedings{neubig2015multi,
  author = {Graham Neubig and Philip Arthur and Kevin Duh},
  title = {{Multi-Target Machine Translation with Multi-Synchronous Context-free Grammars}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2015},
  doi = {10.3115/v1/n15-1033},
}
Figure