No article text was recorded for this version.
dynamic benchmark evolution
Version 1 of 131 papers34 conceptsfrozen 2026-10-04
Papers in this version
- Blog: LDBC Graphalytics: A Benchmark for Large-Scale Graph Analysis on Parallel and Distributed Platforms
- Blog: The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
- Blog: Benchmark Data Repositories for Better Benchmarking
- Blog: NAPAbench 2: A network synthesis algorithm for generating realistic protein-protein interaction (PPI) network families
- Blog: Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views
- Blog: GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
- Blog: MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures
- Blog: A benchmark for prediction of transcriptomic responses to chemical perturbations across cell types
- Blog: OrionBench: Benchmarking Time Series Generative Models in the Service of the End-User
- Blog: NLPre: A Revised Approach towards Language-centric Benchmarking of Natural Language Preprocessing Systems
- Blog: Theseus: Navigating the Labyrinth of Time-Series Anomaly Detection
- Blog: Progress and Prospects for Spoken Language Technology: Results from Four Sexennial Surveys
- Blog: Realistic Evaluation of TabPFN v2.5 in Open Environments
- Blog: Evaluating LLMs' divergent thinking capabilities for scientific idea generation with minimal context
- Blog: The Benchmark Lottery
- Blog: Continuous evaluation of denoising strategies in resting-state fMRI connectivity using fMRIPrep and Nilearn
- Blog: BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices
- Blog: EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluations
- Blog: Benchmark models, planes, lines and points for future SUSY searches at the LHC
- Blog: LiveOIBench: Can Large Language Models Outperform Human Contestants in Informatics Olympiads?
- Blog: GrowOVER: How Can LLMs Adapt to Growing Real-World Knowledge?
- Blog: The HDA+ Data Set for Research on Fully Automated Re-identification Systems
- Blog: TREC-COVID: constructing a pandemic information retrieval test collection
- Blog: Continual Learning in Practice
- Blog: GlobalBench: A Benchmark for Global Progress in Natural Language Processing
- Blog: SocioDojo: Building Lifelong Analytical Agents with Real-world Text and Time Series
- Blog: Finance Language Model Evaluation (FLaME)
- Blog: MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understanding
- Blog: Benchopt: Reproducible, efficient and collaborative optimization benchmarks
- Blog: LiveBench: A Challenging, Contamination-Limited LLM Benchmark
- Blog: DECONbench: a benchmarking platform dedicated to deconvolution methods for tumor heterogeneity quantification
History & citation
Current · Permanent link
- This direction split from Dynamic and Time Sensitive Benchmarking for Language Models (68% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_dynamic_benchmark_evolution_6da7529d,
title = {dynamic benchmark evolution},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/dynamic-benchmark-evolution/rdr_6da7529d8562469b841723b373b8bec9},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_dynamic_benchmark_evolution_6da7529d_v1,
title = {dynamic benchmark evolution},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/dynamic-benchmark-evolution/rdr_6da7529d8562469b841723b373b8bec9/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}