No article text was recorded for this version.
automated metric misalignment (evaluation metric limitations)
Version 2 of 2314 papers415 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Has Machine Translation Evaluation Achieved Human Parity? The Human Reference and the Limits of Progress
- Blog: APE at Scale and Its Implications on MT Evaluation Biases
- Blog: Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets
- Blog: Sentence-Level Quality Estimation for MT System Combination
- Blog: Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translation
- Blog: PhoMT: A High-Quality and Large-Scale Benchmark Dataset for Vietnamese-English Machine Translation
- Blog: BSTC: A Large-Scale Chinese-English Speech Translation Dataset
- Blog: Findings of the Third Workshop on Automatic Simultaneous Translation
- Blog: Measuring the behavioral impact of machine translation quality improvements with A/B testing
- Blog: Towards Optimal Choice Selection for Improved Hybrid Machine Translation
- Blog: Findings of the WMT 2020 Shared Task on Machine Translation Robustness
- Blog: Part Represents Whole: Improving the Evaluation of Machine Translation System Using Entropy Enhanced Metrics
- Blog: Ibom NLP: A Step Toward Inclusive Natural Language Processing for Nigeria's Minority Languages
- Blog: DivEMT: Neural Machine Translation Post-Editing Effort Across Typologically Diverse Languages
- Blog: MLQE-PE: A Multilingual Quality Estimation and Post-Editing Dataset
- Blog: Findings of the IWSLT 2024 Evaluation Campaign
- Blog: Is all that Glitters in Machine Translation Quality Estimation really Gold?
- Blog: Overview of the 3rd Workshop on Asian Translation
- Blog: Overview of the 7th Workshop on Asian Translation
- Blog: How effective is machine translation on low-resource code-switching? A case study comparing human and automatic metrics
- Blog: The Impact of Reference Quality on Automatic MT Evaluation
- Blog: Low-resource Machine Translation for Code-switched Kazakh-Russian Language Pair
- Blog: On The Evaluation of Machine Translation SystemsTrained With Back-Translation
- Blog: Empirical Assessment of kNN-MT for Real-World Translation Scenarios
- Blog: Translationese as a Language in "Multilingual" NMT
- Blog: The devil is in the details: on the pitfalls of vocabulary selection in neural machine translation.
- Blog: MTEQA at WMT21 Metrics Shared Task
- Blog: Randomized Significance Tests in Machine Translation
- Blog: MLQE-PE: A Multilingual Quality Estimation and Post-Editing Dataset
- Blog: Review and analysis of China workshop on machine translation 2013 evaluation
- Blog: HyTER: Meaning-Equivalent Semantics for Translation Evaluation
- Blog: Machine Translation Evaluation: A Survey
- Blog: Low-resource Machine Translation for Code-switched Kazakh-Russian Language Pair
- Blog: Towards Speech-to-Pictograms Translation
- Blog: Human-Paraphrased References Improve Neural Machine Translation
- Blog: Do LLMs Understand Wine Descriptors Across Cultures? A Benchmark for Cultural Adaptations of Wine Reviews
- Blog: The Helsinki Neural Machine Translation System
- Blog: Statistical Machine Translation of Australian Aboriginal Languages: Morphological Analysis with Languages of Differing Morphological Richness
- Blog: Findings of the First WMT Shared Task on Sign Language Translation (WMT-SLT22)
- Blog: Getting Expert Quality from the Crowd for Machine Translation Evaluation
- Blog: Statistical machine translation for biomedical text: are we there yet?
- Blog: Human Evaluation of Multi-modal Neural Machine Translation: A Case-Study on E-Commerce Listing Titles
- Blog: Statistical Post-Editing of a Rule-Based Machine Translation System
- Blog: Is This Translation Error Critical?: Classification-Based Human and Automatic Machine Translation Evaluation Focusing on Critical Errors
- Blog: Rethinking the Reasonability of the Test Set for Simultaneous Machine Translation
- Blog: Sogou Neural Machine Translation Systems for WMT17
- Blog: Overview of the IWSLT 2005 evaluation campaign
- Blog: ILR-Based MT Comprehension Test with Multi-Level Questions
- Blog: Overview of the 2nd Workshop on Asian Translation
- Blog: On The Evaluation of Machine Translation Systems Trained With Back-Translation
- Blog: MLQE-PE: A Multilingual Quality Estimation and Post-Editing Dataset
- Blog: Microsoft Research Treelet Translation System: NAACL 2006 Europarl Evaluation
- Blog: Facebook AI WMT21 News Translation Task Submission
- Blog: The Benefits of Being Uncertain: Perplexity as a Signal for Naturalness in Multilingual Machine Translation
- Blog: DivEMT: Neural Machine Translation Post-Editing Effort Across Typologically Diverse Languages
- Blog: Translationese as a Language in "Multilingual" NMT
- Blog: Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages
- Blog: A Case Against Implicit Standards: Homophone Normalization in Machine Translation for Languages that use the Ge’ez Script.
- Blog: Machine Translation Human Evaluation: an investigation of evaluation based on Post-Editing and its relation with Direct Assessment
- Blog: Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation
Showing 60 of 314 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_automated_metric_misalignment_evaluation_1c04b96c,
title = {automated metric misalignment (evaluation metric limitations)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/automated-metric-misalignment-evaluation-metric-limitations/rdr_1c04b96c989344f188d1d93d4811a349},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_automated_metric_misalignment_evaluation_1c04b96c_v2,
title = {automated metric misalignment (evaluation metric limitations)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/automated-metric-misalignment-evaluation-metric-limitations/rdr_1c04b96c989344f188d1d93d4811a349/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}