No article text was recorded for this version.
cost of human evaluation
Version 2 of 288 papers92 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Appraise Evaluation Framework for Machine Translation
- Blog: Crowd-based MT Evaluation for non-English Target Languages
- Blog: Exploring gap filling as a cheaper alternative to reading comprehension questionnaires when evaluating machine translation for gisting.
- Blog: How do Humans Evaluate Machine Translation
- Blog: EED: Extended Edit Distance Measure for Machine Translation
- Blog: Exploring Gap Filling as a Cheaper Alternative to Reading Comprehension Questionnaires when Evaluating Machine Translation for Gisting
- Blog: Quantitative evaluation of effects of speech recognition errors on speech translation quality
- Blog: Randomized Significance Tests in Machine Translation
- Blog: A Human Judgement Corpus and a Metric for Arabic MT Evaluation
- Blog: Efficient Elicitation of Annotations for Human Evaluation of Machine Translation
- Blog: HyTER: Meaning-Equivalent Semantics for Translation Evaluation
- Blog: Machine Translation Evaluation: A Survey
- Blog: MiTTenS: A Dataset for Evaluating Gender Mistranslation
- Blog: Domain Adaptation of Statistical Machine Translation using Web-Crawled Resources: A Case Study
- Blog: Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation
- Blog: Experiments with Term Translation
- Blog: Using Graph-Based Methods to Augment Online Dictionaries of Endangered Languages
- Blog: Adaptive Few-shot Prompting for Machine Translation with Pre-trained Language Models
- Blog: Overview of the 9th Workshop on Asian Translation
- Blog: A Machine Learning Approach to the Automatic Evaluation of Machine Translation
- Blog: An Automatic Evaluation Method for Localization Oriented Lexicalised EBMT System
- Blog: Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation
- Blog: AM-FM: A Semantic Framework for Translation Quality Assessment
- Blog: Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task
- Blog: AI-Assisted Human Evaluation of Machine Translation
- Blog: SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window
- Blog: IndicMT Eval: A Dataset to Meta-Evaluate Machine Translation Metrics for Indian Languages
- Blog: The Benefit of Pseudo-Reference Translations in Quality Estimation of MT Output
- Blog: Automatic Evaluation of Chinese Translation Output: Word-Level or Character-Level?
- Blog: Getting Expert Quality from the Crowd for Machine Translation Evaluation
- Blog: Towards the evaluation of automatic simultaneous speech translation from a communicative perspective
- Blog: Predicting Human-Targeted Translation Edit Rate via Untrained Human Annotators
- Blog: Automatic Machine Translation Evaluation using Source Language Inputs and Cross-lingual Language Model
- Blog: Test Suite Evaluation: Morphological Challenges and Pronoun Translation
- Blog: Measuring the Effects of Human and Machine Translation on Website Engagement
- Blog: Regression for Sentence-Level MT Evaluation with Pseudo References
- Blog: Evaluating Machine Translation Systems with Second Language Proficiency Tests
- Blog: Probing the Lexicon in Evaluating Commercial MT Systems
- Blog: Paraphrasing for Automatic Evaluation
- Blog: (Meta-) Evaluation of Machine Translation
- Blog: A Language-Independent Approach to Keyphrase Extraction and Evaluation
- Blog: On The Evaluation of Machine Translation Systems Trained With Back-Translation
- Blog: Using Source-Side Confidence Estimation for Reliable Translation into Unfamiliar Languages
- Blog: LiTransProQA: An LLM-based Literary Translation Evaluation Metric with Professional Question Answering
- Blog: ITS: Interactive Translation System
- Blog: Preliminary Ranking of WMT25 General Machine Translation Systems
- Blog: AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages
- Blog: Applications of Automatic Evaluation Methods to Measuring a Capability of Speech Translation System
- Blog: Precision and Recall of Machine Translation
- Blog: Fine-Tuned Machine Translation Metrics Struggle in Unseen Domains
- Blog: Toward More Effective Human Evaluation for Machine Translation
- Blog: Findings of the 2014 Workshop on Statistical Machine Translation
- Blog: A Measure of the System Dependence of Automated Metrics
- Blog: Towards Efficient Machine Translation Evaluation by Modelling Annotators
- Blog: Evaluating Language Translation Models by Playing Telephone
- Blog: SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translation
- Blog: A Web Application for the Diagnostic Evaluation of Machine Translation over Specific Linguistic Phenomena
- Blog: BiVert: Bidirectional Vocabulary Evaluation Using Relations for Machine Translation
- Blog: Results of the WMT18 Metrics Shared Task: Both characters and embeddings achieve good performance
- Blog: Reference-Less Evaluation of Machine Translation: Navigating Through the Resource-Scarce Scenarios
Showing 60 of 88 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_cost_of_human_evaluation_061b19da,
title = {cost of human evaluation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/cost-of-human-evaluation/rdr_061b19dad7e044fc9576d488cb67ec42},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_cost_of_human_evaluation_061b19da_v2,
title = {cost of human evaluation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/cost-of-human-evaluation/rdr_061b19dad7e044fc9576d488cb67ec42/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}