No article text was recorded for this version.
computational evaluation overhead (computational overhead of LLM-based evaluation)
Version 1 of 144 papers44 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Explaining Datasets in Words: Statistical Models with Natural Language Parameters
- Blog: PairEval: Open-domain Dialogue Evaluation Metric with Pairwise Comparisons
- Blog: Exploring GPT-4 Vision for Text-to-Image Synthesis Evaluation
- Blog: Optimization of Reference-less Evaluation Metric of Grammatical Error Correction for Manual Evaluations
- Blog: Large Language Models are Diverse Role-Players for Summarization Evaluation
- Blog: Large Language Models to Enhance Bayesian Optimization
- Blog: RepEval: Effective Text Evaluation with LLM Representation
- Blog: Visual Programming for Step-by-Step Text-to-Image Generation and Evaluation
- Blog: ALOHa: A New Measure for Hallucination in Captioning Models
- Blog: AXCEL: Automated eXplainable Consistency Evaluation using LLMs
- Blog: From Model-centered to Human-Centered: Revision Distance as a Metric for Text Evaluation in LLMs-based Applications
- Blog: CREPE: Rapid Chest X-ray Report Evaluation by Predicting Multi-category Error Counts
- Blog: Self-Taught Evaluators
- Blog: Jointly Reinforcing Diversity and Quality in Language Model Generations
- Blog: NegRefine: Refining Negative Label-Based Zero-Shot OOD Detection
- Blog: QAEval: Mixture of Evaluators for Question-Answering Task Evaluation
- Blog: The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation
- Blog: Multi-Objective Task-Aware Predictor for Image-Text Alignment
- Blog: More Than What Was Chosen: LLM-based Explainable Recommendation Beyond Noisy User Preferences
- Blog: PEDANTS: Cheap but Effective and Interpretable Answer Equivalence
- Blog: Assessing Reference-Free Peer Evaluation for Machine Translation
- Blog: TabXEval: Why this is a Bad Table? An eXhaustive Rubric for Table Evaluation
- Blog: A New HOPE: Domain-agnostic Automatic Evaluation of Text Chunking
- Blog: FLEX: Expert-level False-Less EXecution Metric for Text-to-SQL Benchmark
- Blog: Confidence Calibration for Multimodal LLMs: An Empirical Study Through Medical VQA
- Blog: AskQE: Question Answering as Automatic Evaluation for Machine Translation
- Blog: TIT-Score: Evaluating Long-Prompt Based Text-to-Image Alignment via Text-to-Image-to-Text Consistency
- Blog: Quantifying Semantic Emergence in Language Models
- Blog: CLAIR: Evaluating Image Captions with Large Language Models
- Blog: imapScore: Medical Fact Evaluation Made Easy
- Blog: F2TEval: Human-Aligned Multi-Dimensional Evaluation for Figure-to-Text Task
- Blog: Training Diffusion Models with Reinforcement Learning
- Blog: A Modular Approach for Multimodal Summarization of TV Shows
- Blog: ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmark
- Blog: Improving Automatic VQA Evaluation Using Large Language Models
- Blog: Measuring and Improving Semantic Diversity of Dialogue Generation
- Blog: LLM-Supported Natural Language to Bash Translation
- Blog: X-ACE: Explainable and Multi-factor Audio Captioning Evaluation
- Blog: Make LLM a Testing Expert: Bringing Human-like Interaction to Mobile GUI Testing via Functionality-aware Decisions
- Blog: Introducing Spatial Information and a Novel Evaluation Scheme for Open-Domain Live Commentary Generation
- Blog: Enhancing the Comprehensibility of Text Explanations via Unsupervised Concept Discovery
- Blog: Empowering a Metric with LLM-assisted Named Entity Annotation: HW-TSC’s Submission to the WMT23 Metrics Shared Task
- Blog: Rectifying Shortcut Behaviors in Preference-based Reward Learning
- Blog: Is This a Bad Table? A Closer Look at the Evaluation of Table Generation from Text
History & citation
Current · Permanent link
- This direction split from Efficient Model-Based Evaluation for Generative AI (68% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_computational_evaluation_overhead_comput_8736221e,
title = {computational evaluation overhead (computational overhead of LLM-based evaluation)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/computational-evaluation-overhead-computational-overhead-of-llm-based-evaluation/rdr_8736221edf934fdd9e9e85874412a4a6},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_computational_evaluation_overhead_comput_8736221e_v1,
title = {computational evaluation overhead (computational overhead of LLM-based evaluation)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/computational-evaluation-overhead-computational-overhead-of-llm-based-evaluation/rdr_8736221edf934fdd9e9e85874412a4a6/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}