Adequacy-Fluency Metrics: Evaluating MT in the Continuous Space Model Framework
Lists
Only you see this
Abstract
This work extends and evaluates a two-dimensional automatic evaluation metric for machine translation, which is designed to operate at the sentence level. The metric is based on the concepts of adequacy and fluency, aiming at decoupling both semantic and syntactic components of the translation process to provide a more balanced view on translation quality. These two elements are independently evaluated by using continuous space and <formula formulatype="inline" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex Notation="TeX">$n$</tex> </formula> -gram language modeling frameworks, respectively. Two different implementations are evaluated: a monolingual version that fully operates on the target language side, and a cross-language version that has the main advantage of not requiring reference translations. Both implementations are evaluated by comparing their performance with state-of-the-art automatic metrics over a dataset involving five different European languages.
BibTeX
@article{banchs2015adequacy,
author = {Rafael E. Banchs and Luis F. D'Haro and Haizhou Li},
title = {{Adequacy-Fluency Metrics: Evaluating MT in the Continuous Space Model Framework}},
journal = {IEEE ACM Trans. Audio Speech Lang. Process.},
year = {2015},
doi = {10.1109/taslp.2015.2405751},
}Loading related content...