No article text was recorded for this version.
correlated annotator bias
Version 1 of 151 papers63 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Learning from Crowds by Modeling Common Confusions
- Blog: Unsupervised Aggregation for Classification Problems with Large Numbers of Categories
- Blog: Aggregating Binary Judgments Ranked by Accuracy
- Blog: Crowdsourcing via Pairwise Co-occurrences: Identifiability and Algorithms
- Blog: Deep Generative Crowdsourcing Learning with Worker Correlation Utilization
- Blog: Crowdsourcing Control: Moving Beyond Multiple Choice
- Blog: Trustable Co-Label Learning From Multiple Noisy Annotators
- Blog: Active Learning from Crowds
- Blog: Peer Grading in a Course on Algorithms and Data Structures: Machine Learning Algorithms do not Improve over Simple Baselines
- Blog: Mitigating Observation Biases in Crowdsourced Label Aggregation
- Blog: A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truth
- Blog: On the Cost Complexity of Crowdsourcing
- Blog: Incentivizing the Workers for Truth Discovery in Crowdsourcing with Copiers
- Blog: Scheduling with Predictions and the Price of Misprediction
- Blog: Learning Supervised Topic Models for Classification and Regression from Crowds
- Blog: Deep Learning From Crowdsourced Labels: Coupled Cross-Entropy Minimization, Identifiability, and Regularization
- Blog: Max-MIG: an Information Theoretic Approach for Joint Learning from Crowds
- Blog: Learning by aggregating experts and filtering novices: a solution to crowdsourcing problems in bioinformatics
- Blog: Stability and Multigroup Fairness in Ranking with Uncertain Predictions
- Blog: Toward Unified Evaluation of Mathematical AI: A Survey and Framework
- Blog: Where to: Crowd-Aided Path Selection by Selective Bayesian Network
- Blog: Exploiting Worker Correlation for Label Aggregation in Crowdsourcing
- Blog: Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration
- Blog: Accounting for Confirmation Bias in Crowdsourced Label Aggregation
- Blog: Crowdsourcing with Arbitrary Adversaries
- Blog: Lean Crowdsourcing: Combining Humans and Machines in an Online System
- Blog: Graph Mining Meets Crowdsourcing: Extracting Experts for Answer Aggregation
- Blog: Decision Aggregation under Quantal Response
- Blog: Finite-time influence systems and the Wisdom of Crowd effect
- Blog: Crowd computing: a survey
- Blog: STABLEVAL: Disagreement-Aware and Stable Evaluation of AI Systems
- Blog: Dynamically Switching between Synergistic Workflows for Crowdsourcing
- Blog: On Employing a Highly Mismatched Crowd for Speech Transcription
- Blog: Sequence labeling with multiple annotators
- Blog: A Deep Learning Approach to Unsupervised Ensemble Learning
- Blog: On Efficient and Statistical Quality Estimation for Data Annotation
- Blog: Get another label? improving data quality and data mining using multiple, noisy labelers
- Blog: Collaborative Adaptive Labeling with Imperfect Labelers and Selective Expert Escalation
- Blog: Learning from crowds for automated histopathological image segmentation
- Blog: Multi-annotator Deep Learning: A Probabilistic Framework for Classification
- Blog: Crowd Access Path Optimization: Diversity Matters
- Blog: People make mistakes: Obtaining accurate ground truth from continuous annotations of subjective constructs
- Blog: Don’t Label Twice: Quantity Beats Quality when Comparing Binary Classifiers on a Budget
- Blog: Max-MIG: an Information Theoretic Approach for Joint Learning from Crowds
- Blog: Evaluating Classifiers by Means of Test Data with Noisy Labels
- Blog: Bayesian Detector Combination for Object Detection with Crowdsourced Annotations
- Blog: Estimating the accuracies of multiple classifiers without labeled data
- Blog: Nonresponse and Measurement Error Variance among Interviewers in Standardized and Conversational Interviewing
- Blog: Crowdsourcing via Annotator Co-occurrence Imputation and Provable Symmetric Nonnegative Matrix Factorization
- Blog: Crowdsourcing Regression: A Spectral Approach
- Blog: Humanly Certifying Superhuman Classifiers
History & citation
Current · Permanent link
- Modeling Shared Biases in Crowdsourced Label Aggregation merged into this direction (56% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_correlated_annotator_bias_c0c0c187,
title = {correlated annotator bias},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/correlated-annotator-bias/rdr_c0c0c18751624b9885b6793bc633c2cd},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_correlated_annotator_bias_c0c0c187_v1,
title = {correlated annotator bias},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/correlated-annotator-bias/rdr_c0c0c18751624b9885b6793bc633c2cd/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}