Evaluating machine translation with LFG dependencies

Karolina Owczarzak, Josef van Genabith, Andy WayMach. Transl 2007 · OpenReview

Abstract

In this paper we show how labelled dependencies produced by a Lexical-Functional Grammar parser can be used in Machine Translation evaluation. In contrast to most popular evaluation metrics based on surface string comparison, our dependency-based method does not unfairly penalize perfectly valid syntactic variations in the translation, shows less bias towards statistical models, and the addition of WordNet provides a way to accommodate lexical differences. In comparison with other metrics on a Chinese–English newswire text, our method obtains high correlation with human scores, both on a segment and system level.
BibTeX
@inproceedings{owczarzak2007evaluating,
  author = {Karolina Owczarzak and Josef van Genabith and Andy Way},
  title = {{Evaluating machine translation with LFG dependencies}},
  booktitle = {Mach. Transl},
  year = {2007},
  url = {https://openreview.net/forum?id=htxg4TZZSb},
}

Loading related content...

Figure