No article text was recorded for this version.
reference-anchored evaluation
Version 1 of 145 papers59 conceptsfrozen 2026-10-04
Papers in this version
- Blog: CriticEval: Evaluating Large-scale Language Model as Critic
- Blog: References Improve LLM Alignment in Non-Verifiable Domains
- Blog: DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
- Blog: RevisEval: Improving LLM-as-a-Judge via Response-Adapted References
- Blog: Prometheus: Inducing Fine-Grained Evaluation Capability in Language Models
- Blog: Evaluating Language Models for Generating and Judging Programming Feedback
- Blog: Detecting Errors in AI-Generated Annotations: When and Why Semantic Neighbors Help
- Blog: ReFeR: Improving Evaluation and Reasoning through Hierarchy of Models
- Blog: AlignBench: Benchmarking Chinese Alignment of Large Language Models
- Blog: Weak Reward Model Transforms Generative Models into Robust Causal Event Extraction Systems
- Blog: Finding Blind Spots in Evaluator LLMs with Interpretable Checklists
- Blog: LLMEval: A Preliminary Study on How to Evaluate Large Language Models
- Blog: MM-CRITIC: A Holistic Evaluation of Large Multimodal Models as Multimodal Critique
- Blog: Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
- Blog: Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand
- Blog: CAMIEval: Enhancing NLG Evaluation through Multidimensional Comparative Instruction-Following Analysis
- Blog: CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era
- Blog: VerifyBench: Benchmarking Reference-based Reward Systems for Large Language Models
- Blog: LitReview Arena: Evaluating Literature Review Agents with Battle-style Peer Review Platform
- Blog: On Cost-Effective LLM-as-a-Judge Improvement Techniques
- Blog: Post Hoc Regression Refinement via Pairwise Rankings
- Blog: Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation
- Blog: Keep Your Eye on the Best: Contrastive Regression Transformer for Skill Assessment in Robotic Surgery
- Blog: LINKAGE: Listwise Ranking among Varied-Quality References for Non-Factoid QA Evaluation via LLMs
- Blog: Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation
- Blog: ULTRAFEEDBACK: Boosting Language Models with Scaled AI Feedback
- Blog: The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation
- Blog: Training Language Models to Critique With Multi-agent Feedback
- Blog: Evaluating the Smooth Control of Attribute Intensity in Text Generation with LLMs
- Blog: RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue
- Blog: Can We Use Large Language Models to Fill Relevance Judgment Holes?
- Blog: StackEval: Benchmarking LLMs in Coding Assistance
- Blog: A User-Centric Multi-Intent Benchmark for Evaluating Large Language Models
- Blog: Grading Massive Open Online Courses Using Large Language Models
- Blog: FiNE: Filtering and Improving Noisy Data Elaborately with Large Language Models
- Blog: Do LLM Evaluators Prefer Themselves for a Reason?
- Blog: Evaluation of search-enabled pretrained Large Language Models on retrieval tasks for the PubChem database
- Blog: Models of Translation Competitions
- Blog: JuStRank: Benchmarking LLM Judges for System Ranking
- Blog: Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation
- Blog: How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs?
- Blog: The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs
- Blog: Return of EM: Entity-driven Answer Set Expansion for QA Evaluation
- Blog: Towards Large Language Models that Benefit for All: Benchmarking Group Fairness in Reward Models
- Blog: Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form Text
History & citation
Current · Permanent link
- This direction split from Reference Anchored Evaluation for Language Models (78% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_reference_anchored_evaluation_0cdee96b,
title = {reference-anchored evaluation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/reference-anchored-evaluation/rdr_0cdee96be1f7476ab89b8856d3b0ab2e},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_reference_anchored_evaluation_0cdee96b_v1,
title = {reference-anchored evaluation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/reference-anchored-evaluation/rdr_0cdee96be1f7476ab89b8856d3b0ab2e/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}