No article text was recorded for this version.
gold-standard scarcity
Version 1 of 169 papers69 conceptsfrozen 2026-10-04
Papers in this version
- Blog: TIGERScore: Towards Building Explainable Metric for All Text Generation Tasks
- Blog: Learning to Compare for Better Training and Evaluation of Open Domain Natural Language Generation Models
- Blog: ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation
- Blog: Rethinking Hallucinations: Correctness, Consistency, and Prompt Multiplicity
- Blog: From General Reward to Targeted Reward: Improving Open-ended Long-context Generation Models
- Blog: ReFeR: A Hierarchical Framework of Models as Evaluative and Reasoning Agents
- Blog: Reference-free Summarization Evaluation via Semantic Correlation and Compression Ratio
- Blog: Re-evaluating Evaluation in Text Summarization
- Blog: ARGENT: Automatic Reference-free Evaluation for Open-Ended Text Generation without Source Inputs
- Blog: Semantic Evaluation of Multilingual Data-to-Text Generation via NLI Fine-Tuning: Precision, Recall and F1 scores
- Blog: Zero-shot prompt-based classification: topic labeling in times of foundation models in German Tweets
- Blog: Cross-Examination Framework: A Task-Agnostic Diagnostic for Information Fidelity in Text-to-Text Generation
- Blog: Packing the meeting summarization knapsack
- Blog: Towards Scalable Human-aligned Benchmark for Text-guided Image Editing
- Blog: A Semantic QA-Based Approach for Text Summarization Evaluation
- Blog: Multi-Dimensional Evaluation of Text Summarization with In-Context Learning
- Blog: COSMIC: Mutual Information for Task-Agnostic Summarization Evaluation
- Blog: CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation
- Blog: Summarization Evaluation in the Absence of Human Model Summaries Using the Compositionality of Word Embeddings
- Blog: Optimizing Statistical Machine Translation for Text Simplification
- Blog: Towards Reference-free Text Simplification Evaluation with a BERT Siamese Network Architecture
- Blog: Perception Score: A Learned Metric for Open-ended Text Generation Evaluation
- Blog: QACE: Asking Questions to Evaluate an Image Caption
- Blog: Can ChatGPT Replace Traditional KBQA Models? An In-Depth Analysis of the Question Answering Performance of the GPT LLM Family
- Blog: Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendation
- Blog: Reference-Free Estimation of the Quality of Clinical Notes Generated from Doctor-Patient Conversations
- Blog: A Language Modelling Approach to Quality Assessment of OCR'ed Historical Text
- Blog: Forging Robust Cognition Resilience in Large Language Models: The Self-Correction Reflection Paradigm Against Input Perturbations
- Blog: KPQA: A Metric for Generative Question Answering Using Keyphrase Weights
- Blog: ALTER: Auxiliary Text Rewriting Tool for Natural Language Generation
- Blog: Evaluating Text Generation Quality Using Spectral Distances of Surprisal
- Blog: Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization
- Blog: GLEU: Automatic Evaluation of Sentence-Level Fluency
- Blog: Play the Shannon Game with Language Models: A Human-Free Approach to Summary Evaluation
- Blog: EVIA 2023 Preface
- Blog: Automated Pyramid Scoring of Summaries using Distributional Semantics
- Blog: C²: Scalable Auto-Feedback for LLM-based Chart Generation
- Blog: CAVA: A Tool for Cultural Alignment Visualization & Analysis
- Blog: SocREval: Large Language Models with the Socratic Method for Reference-free Reasoning Evaluation
- Blog: MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers
- Blog: Towards Optimizing and Evaluating a Retrieval Augmented QA Chatbot using LLMs with Human-in-the-Loop
- Blog: GLGE: A New General Language Generation Evaluation Benchmark
- Blog: Simplicity Level Estimate (SLE): A Learned Reference-Less Metric for Sentence Simplification
- Blog: An Automatic Method for Summary Evaluation Using Multiple Evaluation Results by a Manual Method
- Blog: FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model
- Blog: RISE: Leveraging Retrieval Techniques for Summarization Evaluation
- Blog: Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA
- Blog: Argument Summarization and its Evaluation in the Era of Large Language Models
- Blog: Is Temperature the Creativity Parameter of Large Language Models?
- Blog: (Towards) Scalable Reliable Automated Evaluation with Large Language Models
- Blog: Distribution Aware Metrics for Conditional Natural Language Generation
- Blog: DocAsRef: An Empirical Study on Repurposing Reference-based Summary Quality Metrics as Reference-free Metrics
- Blog: FreshTab: Sourcing Fresh Data for Table-to-Text Generation Evaluation
- Blog: Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level
- Blog: Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability
- Blog: UMSE: Unified Multi-scenario Summarization Evaluation
- Blog: SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling
- Blog: Comparative Document Summarisation via Classification
- Blog: A Training-free and Reference-free Summarization Evaluation Metric via Centrality-weighted Relevance and Self-referenced Redundancy
- Blog: Universal Self-Consistency for Large Language Models
Showing 60 of 69 papers.
History & citation
Current · Permanent link
- This direction split from Reference-Free Evaluation of Generative Models (54% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_gold_standard_scarcity_1aeb8f26,
title = {gold-standard scarcity},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/gold-standard-scarcity/rdr_1aeb8f2667494ea9a1a1fa3a223f425f},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_gold_standard_scarcity_1aeb8f26_v1,
title = {gold-standard scarcity},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/gold-standard-scarcity/rdr_1aeb8f2667494ea9a1a1fa3a223f425f/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}