No article text was recorded for this version.
benchmark label noise
Version 1 of 1233 papers321 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks
- Blog: CrossWeigh: Training Named Entity Tagger from Imperfect Annotations
- Blog: Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Models
- Blog: Why Do Deep Neural Networks Still Not Recognize These Images?: A Qualitative Analysis on Failure Cases of ImageNet Classification
- Blog: How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230, 000 3D facial landmarks)
- Blog: Puzzle Curriculum GRPO for Vision-Centric Reasoning
- Blog: Pushing the Limits of All-Atom Geometric Graph Neural Networks: Pre-Training, Scaling and Zero-Shot Transfer
- Blog: Handling Noisy Training and Testing Data
- Blog: ChatEL: Entity Linking with Chatbots
- Blog: A Thorough Examination of the CNN/Daily Mail Reading Comprehension Task
- Blog: Benchmarking the Benchmarks: Reproducing Climate-Related NLP Tasks
- Blog: Benchmark Underestimates the Readiness of Multi-lingual Dialogue Agents
- Blog: CleanCoNLL: A Nearly Noise-Free Named Entity Recognition Dataset
- Blog: Robin: a Suite of Multi-Scale Vision-Language Models and the CHIRP Evaluation Benchmark
- Blog: Classification With an Edge: Improving Semantic Image Segmentation with Boundary Detection
- Blog: Sentiment Analysis Is Not Solved! Assessing and Probing Sentiment Classification
- Blog: SEMANTIC SEGMENTATION OF AERIAL IMAGES WITH AN ENSEMBLE OF CNNS
- Blog: Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Models
- Blog: Nibbling at the Hard Core of Word Sense Disambiguation
- Blog: Do Large Language Model Benchmarks Test Reliability?
- Blog: Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its Dialects
- Blog: Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification
- Blog: Are we done with ImageNet?
- Blog: GPUDrive: Data-driven, multi-agent driving simulation at 1 million FPS
- Blog: DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation
- Blog: SimpleQuestions Nearly Solved: A New Upperbound and Baseline Approach
- Blog: Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performance
- Blog: How Far are We from Solving the 2D & 3D Face Alignment Problem? (and a Dataset of 230, 000 3D Facial Landmarks)
- Blog: From ImageNet to Image Classification: Contextualizing Progress on Benchmarks
- Blog: Rationally Reappraising ATIS-based Dialogue Systems
- Blog: TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task
- Blog: Named Entity Recognition - Is There a Glass Ceiling?
- Blog: A Strong and Reproducible Object Detector with Only Public Datasets
- Blog: Dialogue State Tracking with a Language Model using Schema-Driven Prompting
- Blog: Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
- Blog: TIDE: A General Toolbox for Identifying Object Detection Errors
- Blog: LLMs Outperform Experts on Challenging Biology Benchmarks
- Blog: Re-TACRED: Addressing Shortcomings of the TACRED Dataset
- Blog: Feature-Augmented Neural Networks for Patient Note De-identification
- Blog: KAIO: A Collection of More Challenging Korean Questions
- Blog: Scaling Laws For Dense Retrieval
- Blog: Bryndza at ClimateActivism 2024: Stance, Target and Hate Event Detection via Retrieval-Augmented GPT-4 and LLaMA
- Blog: Video-based Person Re-identification without Bells and Whistles
- Blog: Planning and Generating Natural and Diverse Disfluent Texts as Augmentation for Disfluency Detection
- Blog: A Thorough Examination of the CNN/Daily Mail Reading Comprehension Task
- Blog: Evaluation of retrieval-based QA on QUEST-LOFT
- Blog: Approaching Peak Ground Truth
- Blog: A Survey of Document-Level Information Extraction
- Blog: GraphCleaner: Detecting Mislabelled Samples in Popular Graph Learning Benchmarks
- Blog: DeepID3: Face Recognition with Very Deep Neural Networks
- Blog: Visualization Generation with Large Language Models: An Evaluation
- Blog: Validating Label Consistency in NER Data Annotation
- Blog: Understanding Alignment in Multimodal LLMs: A Comprehensive Study
- Blog: A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization
- Blog: Rethinking Generalization of Neural Models: A Named Entity Recognition Case Study
- Blog: Persian Ezafe Recognition Using Transformers and Its Role in Part-Of-Speech Tagging
- Blog: COCONut: Modernizing COCO Segmentation
- Blog: An Improved Baseline for Sentence-level Relation Extraction
- Blog: Effective Use of Context in Noisy Entity Linking
- Blog: Are We Done with MMLU?
Showing 60 of 233 papers.
History & citation
Current · Permanent link
- The Label Noise Ceiling in Benchmark Evaluation merged into this direction (77% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_benchmark_label_noise_ddd3f93a,
title = {benchmark label noise},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/benchmark-label-noise/rdr_ddd3f93a089e4d61ac1f599b28c7ec51},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_benchmark_label_noise_ddd3f93a_v1,
title = {benchmark label noise},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/benchmark-label-noise/rdr_ddd3f93a089e4d61ac1f599b28c7ec51/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}