The Closed World Evaluation Bias in Knowledge Extraction

143 concepts99 papers1 proposal

When evaluating models that extract structured knowledge from text or graphs, the standard practice is to measure their outputs against a human-annotated "gold standard" or reference database. However, this setup relies on a dangerous assumption: the Closed-World Assumption (CWA), which posits that any fact not explicitly recorded in the reference database is false.

Because real-world knowledge bases are inherently incomplete, models are frequently penalized for discovering valid new facts that were simply unrecorded. This fundamental flaw means that what automated benchmarks report as a "false positive" or an extraction error is often a genuine discovery.

The Core Dilemma of Incomplete Ground Truth

The tension between static evaluation sets and dynamic, real-world data creates a systematic measurement gap. As Ni Lao et al. observe in Reading The Web with Learned Syntactic-Semantic Inference Rules, evaluating knowledge extraction systems against a fixed reference creates a pessimistic bias because it penalizes the system for discovering valid, novel information missing from the original ground truth.

This problem stems from a failure to differentiate between factual falsehood and missing data. Volker Tresp et al. emphasize this in Link Prediction in Multi-relational Graphs using Additive Models, noting that treating missing triples as negative evidence fails to distinguish between facts that are false and facts that are simply missing from the knowledge base. As Grave argues in A convex relaxation for weakly supervised relation extraction, this incompleteness causes valid extractions to be incorrectly flagged as errors, meaning that the actual precision of modern models is likely higher than current benchmarks suggest.

The Penalty on Advanced and Agentic Models

The closed-world evaluation bias becomes particularly severe as extraction models grow more capable. When models leverage extensive external knowledge or advanced reasoning capabilities, their ability to find comprehensive information outpaces the static benchmarks used to test them.

For instance, Ananya Ananya et al. demonstrate in Towards Harnessing Large Language Models as Autonomous Agents for Semantic Triple Extraction from Unstructured Text that traditional evaluation metrics fail to account for the high-recall capabilities of language model agents. Because these agents extract more comprehensive data than the original gold standard, they face a performance penalty for correct but uncatalogued predictions, creating a stark discrepancy between quantitative benchmark scores and qualitative accuracy.

Similarly, Mehwish Alam et al. argue in Towards Semantically Enriched Embeddings for Knowledge Graph Completion that the closed-world assumption creates an explicit bias against models with extensive external knowledge, unfairly marking them as incorrect for identifying valid but unrecorded relationships.

Pervasiveness Across Tasks and Modalities

This evaluation gap is not isolated to standard relation extraction; it manifests across coreference resolution, entity typing, biomedical text mining, and even multi-modal systems:

Quantifying the Discrepancy

Just how much does this bias distort our understanding of model performance? Manual human validation and error analysis reveal that the gap is massive.

In the context of knowledge graph completion, the authors of SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models conducted human evaluations and discovered that nearly half of the predicted errors in high-performing models actually represented genuine discoveries rather than mistakes. This indicates that standard metrics severely underestimate model accuracy because the ground-truth graphs are missing so many valid facts.

Similarly, Sebastian Blohm et al. show in Harvesting Relations from the Web - Quantifiying the Impact of Filtering Functions that evaluating web-scale extraction against static gold standards underestimates precision by a significant factor compared to manual human validation, because the web contains a vast number of correct facts not yet represented in reference datasets.

Evolving Beyond the Closed-World Assumption

To build a more accurate picture of model capabilities, researchers are developing evaluation protocols and training paradigms that explicitly account for ground truth incompleteness:

Key Foundational Work

Harvesting Relations from the Web - Quantifiying the Impact of Filtering Functions (2007) — contributed 3 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_knowledge_base_incompleteness_closed_wor_68bf60a6,
  title = {knowledge base incompleteness (closed-world evaluation bias)},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/knowledge-base-incompleteness-closed-world-evaluation-bias/rdr_68bf60a6982648b6ad9ee4777f4f02fd},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}

This exact version (version 1, frozen text):

@misc{lacuna_knowledge_base_incompleteness_closed_wor_68bf60a6_v1,
  title = {knowledge base incompleteness (closed-world evaluation bias)},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/knowledge-base-incompleteness-closed-world-evaluation-bias/rdr_68bf60a6982648b6ad9ee4777f4f02fd/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake