No article text was recorded for this version.
metric overfitting
Version 1 of 168 papers85 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Quality-Aware Decoding for Neural Machine Translation
- Blog: Breeding Machine Translations: Evolutionary approach to survive and thrive in the world of automated evaluation
- Blog: The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement
- Blog: Adding Chocolate to Mint : Mitigating Metric Interference in Machine Translation
- Blog: Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation
- Blog: The Best Lexical Metric for Phrase-Based Statistical MT System Optimization
- Blog: Multi-Metric Optimization Using Ensemble Tuning
- Blog: Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet
- Blog: Can Scientific Impact Be Predicted?
- Blog: Direct Preference Optimization for Neural Machine Translation with Minimum Bayes Risk Decoding
- Blog: Gender-Neutral Rewriting in Italian: Models, Approaches, and Trade-offs
- Blog: The Strong, weak and benign Goodhart’s law. An independence-free and paradigm-agnostic formalisation
- Blog: A Bayesian Optimization Approach to Machine Translation Reranking
- Blog: Position: Machine Learning for Heart Transplant Allocation Policy Optimization Should Account for Incentives
- Blog: Self-Critical Sequence Training for Image Captioning
- Blog: BRIO: Bringing Order to Abstractive Summarization
- Blog: Insider Knowledge: How Much Can RAG Systems Gain from Evaluation Secrets?
- Blog: AUEB-Archimedes at RIRAG-2025: Is Obligation concatenation really all you need?
- Blog: Metrics and Mechanisms: Measuring the Unmeasurable in the Science of Science
- Blog: Strategic Classification
- Blog: AutoEval-ToD: Automated Evaluation of Task-oriented Dialog Systems
- Blog: AI Evaluation Authorities: A Case Study Mapping Model Audits to Persistent Standards
- Blog: Word storms: multiples of word clouds for visual comparison of documents
- Blog: Automated Essay Scoring: A Reflection on the State of the Art
- Blog: A Comprehensive Survey of Deep Learning for Image Captioning
- Blog: Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation
- Blog: ImProver: Agent-Based Automated Proof Optimization
- Blog: Seeing Through Words: Controlling Visual Retrieval Quality with Language Models
- Blog: Sample Selection for Large-scale MT Discriminative Training
- Blog: A Principled Framework for Evaluating Summarizers: Comparing Models of Summary Quality against Human Judgments
- Blog: Few-step Adversarial Schrödinger Bridge for Generative Speech Enhancement
- Blog: Faster Minimum Bayes Risk Decoding with Confidence-based Pruning
- Blog: Learning Counterfactual Explanations for Recommender Systems
- Blog: Mitigating Hallucinated Translations in Large Language Models with Hallucination-focused Preference Optimization
- Blog: Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks
- Blog: Metric-Driven Attributions for Vision Transformers
- Blog: Goodhart's Law Applies to NLP's Explanation Benchmarks
- Blog: Are There Exceptions to Goodhart's law? On the Moral Justification of Fairness-Aware Machine Learning
- Blog: LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts
- Blog: Preference Alignment Improves Language Model-Based TTS
- Blog: Learning to Substitute Words with Model-based Score Ranking
- Blog: DSPy: Compiling Declarative Language Model Calls into State-of-the-Art Pipelines
- Blog: Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs
- Blog: Improved Word-Level System Combination for Machine Translation
- Blog: Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model
- Blog: VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning
- Blog: Improving Text-to-Image Consistency via Automatic Prompt Optimization
- Blog: Findings of the 2011 Workshop on Statistical Machine Translation
- Blog: Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation
- Blog: MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods
- Blog: The Pitfalls of "Security by Obscurity" and What They Mean for Transparent AI
- Blog: Pitfalls and Outlooks in Using COMET
- Blog: Quality Control at Your Fingertips: Quality-Aware Translation Models
- Blog: Evolutionary Caching to Accelerate Your Off-the-Shelf Diffusion Model
- Blog: Augmenting Perceptual Super-Resolution via Image Quality Predictors
- Blog: Cost-Aware Routing for Efficient Text-To-Image Generation
- Blog: When Do Benchmark Scores Predict Deployment? A Validity Framework for Capability Claims
- Blog: Learning to Translate with Multiple Objectives
- Blog: Evaluating Rewards for Question Generation Models
- Blog: A Quality-based Syntactic Template Retriever for Syntactically-Controlled Paraphrase Generation
Showing 60 of 68 papers.
History & citation
Current · Permanent link
- Why Optimizing for Automated Metrics Degrades Model Quality merged into this direction (68% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_metric_overfitting_22a767ce,
title = {metric overfitting},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/metric-overfitting/rdr_22a767ce8e174134836b7ffa38003741},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_metric_overfitting_22a767ce_v1,
title = {metric overfitting},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/metric-overfitting/rdr_22a767ce8e174134836b7ffa38003741/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}