No article text was recorded for this version.
benchmark obsolescence
Version 1 of 1132 papers134 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Artificial intelligence will change the research environment in dental medicine dramatically: will algorithms replace literature reviews in the near future?
- Blog: MMReason: An Open-Ended Multi-Modal Multi-Step Reasoning Benchmark for MLLMs Toward AGI
- Blog: Evaluating Arabic Large Language Models: A Survey of Benchmarks, Methods, and Gaps
- Blog: Is Your Benchmark Still Useful? Dynamic Benchmarking for Code Language Models
- Blog: AutoVerus: Automated Proof Generation for Rust Code
- Blog: On the Shelf Life of Fine-Tuned LLM-Judges: Future-Proofing, Backward-Compatibility, and Question Generalization
- Blog: Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey
- Blog: Language Models can Evaluate Themselves via Probability Discrepancy
- Blog: GPT is an effective tool for multilingual psychological text analysis
- Blog: AIBench Training: Balanced Industry-Standard AI Training Benchmarking
- Blog: AgentRouter: Heterogeneous Model Routing for Cost-Optimal Multi-Step Agentic Workflows
- Blog: SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Tasks
- Blog: VLRewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models
- Blog: Revisiting VerilogEval: A Year of Improvements in Large-Language Models for Hardware Code Generation
- Blog: CLUE: A Chinese Language Understanding Evaluation Benchmark
- Blog: Divergent Creativity in Humans and Large Language Models
- Blog: All You Need Is S P A C E: When Jailbreaking Meets Bias Audit and Reveals What Lies Beneath the Guardrails (Student Abstract)
- Blog: NurseLLM: The First Specialized Language Model for Nursing
- Blog: Scaling Environments for LLM Agents in the Era of Learning from Interaction: A Survey
- Blog: Navigating the Modern Evaluation Landscape: Considerations in Benchmarks and Frameworks for Large Language Models (LLMs)
- Blog: The Cambridge Report on Database Research
- Blog: From Superficial Outputs to Superficial Learning: Risks of Large Language Models in Education
- Blog: Proceedings of the 4th Workshop on Trustworthy Natural Language Processing (TrustNLP 2024)
- Blog: Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels?
- Blog: FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMs
- Blog: The DialPort tools
- Blog: Who Said That? Benchmarking Social Media AI Detection
- Blog: eCBT-I dialogue system: a comparative evaluation of large language models and adaptation strategies for insomnia treatment
- Blog: Dynamic Evaluation for Oversensitivity in LLMs
- Blog: PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods
- Blog: Questioning Our Questions: How Well Do Medical QA Benchmarks Evaluate Clinical Capabilities of Language Models?
- Blog: Safety in Large Reasoning Models: A Survey
- Blog: LLM-Evaluation Tropes: Perspectives on the Validity of LLM-Evaluations
- Blog: Robust privacy amidst innovation with large language models through a critical assessment of the risks
- Blog: Standard Quality Criteria Derived from Current NLP Evaluations for Guiding Evaluation Design and Grounding Comparability and AI Compliance Assessments
- Blog: Chatbots’ Empathetic Conversations and Responses: A Qualitative Study of Help‑Seeking Queries on Depressive Moods Across 8 Commercial Conversational Agents
- Blog: Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP
- Blog: Sample Design Engineering: An Empirical Study on Designing Better Fine-Tuning Samples for Information Extraction with LLMs
- Blog: UINAUIL: A Unified Benchmark for Italian Natural Language Understanding
- Blog: SWIFT: A Scalable Lightweight Infrastructure for Fine-Tuning
- Blog: Measuring the Groundedness of Legal Question-Answering Systems
- Blog: Named Clinical Entity Recognition Benchmark
- Blog: Bootstrapping AI: Interdisciplinary Approaches to Assessing OCR Quality in English-Language Historical Documents
- Blog: Experience is the Best Teacher: Motivating Effective Exploration in Reinforcement Learning for LLMs
- Blog: Humans or LLMs as the Judge? A Study on Judgement Bias
- Blog: SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Models
- Blog: Designing LLM Chains by Adapting Techniques from Crowdsourcing Workflows
- Blog: MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning
- Blog: Benchmarking: Past, Present and Future
- Blog: Assessing large language models as assistive tools in medical consultations for Kawasaki disease
- Blog: ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review
- Blog: Certifiable Evaluation: A Low-Rank Framework for Foundation Model Benchmarking with Formal Performance Guarantees
- Blog: MM-LLMs: Recent Advances in MultiModal Large Language Models
- Blog: Modeling, Evaluating, and Embodying Personality in LLMs: A Survey
- Blog: InstructEval: Towards Holistic Evaluation of Instruction-Tuned Large Language Models
- Blog: Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs
- Blog: Efficient Solutions For An Intriguing Failure of LLMs: Long Context Window Does Not Mean LLMs Can Analyze Long Sequences Flawlessly
- Blog: R-Bench: Are Your Large Multimodal Model Robust to Real-World Corruptions?
- Blog: REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark
- Blog: Reliable, Reproducible, and Really Fast Leaderboards with Evalica
Showing 60 of 132 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_benchmark_obsolescence_c6847219,
title = {benchmark obsolescence},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/benchmark-obsolescence/rdr_c6847219d50941f590c598cb3b9b473f},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_benchmark_obsolescence_c6847219_v1,
title = {benchmark obsolescence},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/benchmark-obsolescence/rdr_c6847219d50941f590c598cb3b9b473f/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}