No article text was recorded for this version.
verbosity bias (length-quality conflation)
Version 2 of 2229 papers333 conceptsfrozen 2026-10-04
Papers in this version
- Blog: LONGQAEVAL: Designing Reliable Evaluations of Long-Form Clinical QA under Resource Constraints
- Blog: An interdisciplinary, randomized, single-blind evaluation of state-of-the-art large language models for their implications and risks in medical diagnosis and management
- Blog: An Empirical Study of Evaluating Long-form Question Answering
- Blog: Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments
- Blog: APPLS: A Meta-evaluation Testbed for Plain Language Summarization
- Blog: The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
- Blog: Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments
- Blog: X-Teaming Evolutionary M2S: Automated Discovery of Multi-turn to Single-turn Jailbreak Templates
- Blog: L-Eval: Instituting Standardized Evaluation for Long Context Language Models
- Blog: MM-CRITIC: A Holistic Evaluation of Large Multimodal Models as Multimodal Critique
- Blog: Prompt Engineering Techniques for Language Model Reasoning Lack Replicability
- Blog: Automatic Short Answer Grading for Finnish with ChatGPT
- Blog: A Critical Evaluation of Evaluations for Long-form Question Answering
- Blog: Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring Systems
- Blog: Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization
- Blog: Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization
- Blog: VITAL: A New Dataset for Benchmarking Pluralistic Alignment in Healthcare
- Blog: Recognizing Insufficiently Supported Arguments in Argumentative Essays
- Blog: Discrete Optimization for Unsupervised Sentence Summarization with Word-Level Extraction
- Blog: Structural Explanation of Automated Essay Scoring
- Blog: Rethinking LLM-based Preference Evaluation
- Blog: How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources
- Blog: XtraGPT: LLMs for Human-AI Collaboration on Controllable Academic Paper Revision
- Blog: Explaining Length Bias in LLM-Based Preference Evaluations
- Blog: An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4
- Blog: LLMEval: A Preliminary Study on How to Evaluate Large Language Models
- Blog: LLMs Cannot (Yet) Match the Specificity and Simplicity of Online Communities in Long Form Question Answering
- Blog: Explaining Length Bias in LLM-Based Preference Evaluations
- Blog: EXPERT: An Explainable Image Captioning Evaluation Metric with Structured Explanations
- Blog: Classifying Constructive Comments
- Blog: L-Eval: Instituting Standardized Evaluation for Long Context Language Models
- Blog: CAMIEval: Enhancing NLG Evaluation through Multidimensional Comparative Instruction-Following Analysis
- Blog: What Are We Measuring When We Evaluate Large Vision-Language Models? An Analysis of Latent Factors and Biases
- Blog: A Critical Evaluation of Evaluations for Long-form Question Answering
- Blog: Style Over Substance: Evaluation Biases for Large Language Models
- Blog: Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual Settings
- Blog: Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the Art
- Blog: Disentangling Length Bias In Preference Learning Via Response-Conditioned Modeling
- Blog: MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark
- Blog: Rationale-Aware Answer Verification by Pairwise Self-Evaluation
- Blog: Benchmarking Large Language Models on Safety Risks in Scientific Labs
- Blog: UCL-Bench: A Chinese User-Centric Legal Benchmark for Large Language Models
- Blog: MMReview: A Multidisciplinary and Multimodal Benchmark for LLM-Based Peer Review Automation
- Blog: Automated Student Answer Scoring Using GloVe-LSTM and Hybrid Similarity Metrics
- Blog: The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
- Blog: Automated Japanese Essay Scoring System based on Articles Written by Experts
- Blog: RubricRobustness: Evaluating the Sensitivity of Rubrics-Based Benchmarks to Simple Perturbations
- Blog: MSQA: Benchmarking LLMs on Graduate-Level Materials Science Reasoning and Knowledge
- Blog: Length Does Matter: Summary Length can Bias Summarization Metrics
- Blog: AnyCap Project: A Unified Framework, Dataset, and Benchmark for Controllable Omni-modal Captioning
- Blog: Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators
- Blog: Length-Controlled AlpacaEval: A Simple Debiasing of Automatic Evaluators
- Blog: HW-TSC at Multilingual Counterspeech Generation
- Blog: AlignBench: Benchmarking Chinese Alignment of Large Language Models
- Blog: BALSAM: A Platform for Benchmarking Arabic Large Language Models
- Blog: CIIR@LiveRAG 2025: Optimizing Multi-Agent Retrieval Augmented Generation through Self-Training
- Blog: Verbosity Bias in Preference Labeling by Large Language Models
- Blog: LLMEval: A Preliminary Study on How to Evaluate Large Language Models
- Blog: Automatic Argument Quality Assessment - New Datasets and Methods
- Blog: Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents
Showing 60 of 229 papers.
History & citation
Current · Permanent link
- Mitigating Verbosity Bias in LLM-as-a-Judge merged into this direction (79% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_verbosity_bias_length_quality_conflation_63784dde,
title = {verbosity bias (length-quality conflation)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/verbosity-bias-length-quality-conflation/rdr_63784dde1d574dc09c7f8cf6524923b3},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 2, frozen text):
@misc{lacuna_verbosity_bias_length_quality_conflation_63784dde_v2,
title = {verbosity bias (length-quality conflation)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/verbosity-bias-length-quality-conflation/rdr_63784dde1d574dc09c7f8cf6524923b3/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-19},
}