No article text was recorded for this version.
cross-domain evaluation robustness
Version 1 of 143 papers56 conceptsfrozen 2026-10-04
Papers in this version
- Blog: A Critical Look at Meta-evaluating Summarisation Evaluation Metrics
- Blog: Relevance in Dialogue: Is Less More? An Empirical Comparison of Existing Metrics, and a Novel Simple Metric
- Blog: Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains
- Blog: Understanding Faithfulness and Reasoning of Large Language Models on Plain Biomedical Summaries
- Blog: Under the Microscope: Interpreting Readability Assessment Models for Filipino
- Blog: Automatic Evaluation of Topic Coherence
- Blog: APPLS: Evaluating Evaluation Metrics for Plain Language Summarization
- Blog: Tweak to Trust: Assessing the Reliability of Summarization Metrics in Contact Centers via Perturbed Summaries
- Blog: Judge the Judges: A Large-Scale Evaluation Study of Neural Language Models for Online Review Generation
- Blog: Beyond Flesch-Kincaid: Prompt-based Metrics Improve Difficulty Classification of Educational Texts
- Blog: Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation
- Blog: LENS: A Learnable Evaluation Metric for Text Simplification
- Blog: FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge
- Blog: Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust
- Blog: Data Collection for Dialogue System: A Startup Perspective
- Blog: Powerful A/B-Testing Metrics and Where to Find Them
- Blog: LexDrafter: Terminology Drafting for Legislative Documents Using Retrieval Augmented Generation
- Blog: Is Reference Necessary in the Evaluation of NLG Systems? When and Where?
- Blog: Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries
- Blog: Automatic Evaluate Dialogue Appropriateness by Using Dialogue Act
- Blog: Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy
- Blog: TRUE: Re-evaluating Factual Consistency Evaluation
- Blog: Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory
- Blog: PoE: a Panel of Experts for Generalized Automatic Dialogue Assessment
- Blog: Graph Generative Models Evaluation with Masked Autoencoder
- Blog: BEMEAE: Moving Beyond Exact Span Match for Event Argument Extraction
- Blog: UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation
- Blog: Quantifying the Limits and Success of Extractive Summarization Systems Across Domains
- Blog: An Automatic Approach for Document-level Topic Model Evaluation
- Blog: Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent
- Blog: DocAsRef: An Empirical Study on Repurposing Reference-based Summary Quality Metrics as Reference-free Metrics
- Blog: Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation
- Blog: Data selection for discriminative training in statistical machine translation
- Blog: Quality Estimation with k-nearest Neighbors and Automatic Evaluation for Model-specific Quality Estimation
- Blog: Evaluating Text Humanlikeness via Self-Similarity Exponent
- Blog: IMPARA-GED: Grammatical Error Detection is Boosting Reference-free Grammatical Error Quality Estimator
- Blog: BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics
- Blog: On the Effectiveness of Automated Metrics for Text Generation Systems
- Blog: Machine Translation Evaluation for Arabic using Morphologically-enriched Embeddings
- Blog: Generative Interpretation: Toward Human-Like Evaluation for Educational Question-Answer Pair Generation
- Blog: Testing English News Articles for Lexical Homogenization Due to Widespread Use of Large Language Models
- Blog: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
- Blog: Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_cross_domain_evaluation_robustness_63a5be8a,
title = {cross-domain evaluation robustness},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/cross-domain-evaluation-robustness/rdr_63a5be8aeff2492dbc66144e35af7b03},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_cross_domain_evaluation_robustness_63a5be8a_v1,
title = {cross-domain evaluation robustness},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/cross-domain-evaluation-robustness/rdr_63a5be8aeff2492dbc66144e35af7b03/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}