No article text was recorded for this version.
reliability-weighted aggregation
Version 1 of 183 papers98 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Learning classifiers from dual annotation ambiguity via a min-max framework
- Blog: AtC: Aggregate-then-Calibrate for Human-centered Assessment
- Blog: Adaptive Task Assignment for Crowdsourced Classification
- Blog: University at Buffalo at SemEval-2023 Task 11: MASDA–Modelling Annotator Sensibilities through DisAggregation
- Blog: Graph Mining Meets Crowdsourcing: Extracting Experts for Answer Aggregation
- Blog: xiacui at SemEval-2023 Task 11: Learning a Model in Mixed-Annotator Datasets Using Annotator Ranking Scores as Training Weights
- Blog: Improving Reliability of Word Similarity Evaluation by Redesigning Annotation Task and Performance Measure
- Blog: Fusion-Eval: Integrating Assistant Evaluators with LLMs
- Blog: Cheaper and Better: Selecting Good Workers for Crowdsourcing
- Blog: Empirical Analysis of Aggregation Methods for Collective Annotation
- Blog: Reliability-Aware LLM Alignment from Inconsistent Human Feedback
- Blog: A Taxonomy, Dataset, and Classifier for Automatic Noun Compound Interpretation
- Blog: Effectively Crowdsourcing Radiology Report Annotations
- Blog: A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truth
- Blog: Dependence-Aware Label Aggregation for LLM-as-a-Judge via Ising Models
- Blog: A New Dataset for Source Code Comment Coherence
- Blog: Effectively integrating information content and structural relationship to improve the GO-based similarity measure between proteins
- Blog: Fusion of image segmentation algorithms using consensus clustering
- Blog: Learning from Multiple Experts with Random Forests: Application to the Segmentation of the Midbrain in 3D Ultrasound
- Blog: peerannot: A framework for label aggregation in crowdsourced datasets
- Blog: [Papers] Multi-classifier Decision: Integration of Multiple Brain Activity-based Classifications
- Blog: Decomposing Generalization: Models of Generic, Habitual and Episodic Statements
- Blog: Who Said What: Modeling Individual Labelers Improves Classification
- Blog: The INTERSPEECH 2012 Speaker Trait Challenge
- Blog: A Generative Bayesian Model for Aggregating Experts' Probabilities
- Blog: Answer Quality Aware Aggregation for Extractive QA Crowdsourcing
- Blog: Automatic Fusion of Segmentation and Tracking Labels
- Blog: Can Humans Correct Errors From System? Investigating Error Tendencies in Speaker Identification Using Crowdsourcing
- Blog: Supervised Collective Classification for Crowdsourcing
- Blog: A Large-scale Dataset for Argument Quality Ranking: Construction and Analysis
- Blog: Six Attributes of Unhealthy Conversation
- Blog: Crowdsourcing with Arbitrary Adversaries
- Blog: MAGI: Multi-Annotated Explanation-Guided Learning
- Blog: Weighted Distance-Based Models for Ranking Data Using the <i>R</i> Package <b>rankdist</b>
- Blog: The OMG-Emotion Behavior Dataset
- Blog: Towards Intelligent Crowdsourcing for Audio Data Annotation: Integrating Active Learning in the Real World
- Blog: An Interactive Multi-Label Consensus Labeling Model for Multiple Labeler Judgments
- Blog: Label Propagation with Weak Supervision
- Blog: A Gold Standard with Silver Linings: Scaling Up Annotation for Distinguishing Bosnian, Croatian, Montenegrin and Serbian
- Blog: Crowdsourced Classification with XOR Queries: Fundamental Limits and An Efficient Algorithm
- Blog: Predicting Human-Targeted Translation Edit Rate via Untrained Human Annotators
- Blog: Affective classification of generic audio clips using regression models
- Blog: Fast Object Detection with Entropy-Driven Evaluation
- Blog: Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biases
- Blog: Optimal Spot-Checking for Improving Evaluation Accuracy of Peer Grading Systems
- Blog: Methods for Ordinal Peer Grading
- Blog: A Blockchain-Enabled Trustless Crowd-Intelligence Ecosystem on Mobile Edge Computing
- Blog: On Optimality of Jury Selection in Crowdsourcing
- Blog: GeAnn at the TREC 2011 Crowdsourcing Track
- Blog: A Blockchain-enabled Trustless Crowd-Intelligence Ecosystem on Mobile Edge Computing
- Blog: Learning an accurate entity resolution model from crowdsourced labels
- Blog: Multi-label Classification for Image Annotation via Sparse Similarity Voting
- Blog: Millionaire: A Hint-guided Approach for Crowdsourcing
- Blog: Multi-Object Classification via Crowdsourcing With a Reject Option
- Blog: Autoencoders for strategic decision support
- Blog: Reliability-Weighted Acoustic Model Adaptation Using Crowd Sourced Transcriptions
- Blog: Neural Networks Assist Crowd Predictions in Discerning the Veracity of Emotional Expressions
- Blog: Semi-automatic Triage of Requests for Free Legal Assistance
- Blog: Estimating Accuracy from Unlabeled Data: A Bayesian Approach
- Blog: Getting Reliable Annotations for Sarcasm in Online Dialogues
Showing 60 of 83 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_reliability_weighted_aggregation_5f70f00a,
title = {reliability-weighted aggregation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/reliability-weighted-aggregation/rdr_5f70f00a8cc74c509622cac68f63bd94},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_reliability_weighted_aggregation_5f70f00a_v1,
title = {reliability-weighted aggregation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/reliability-weighted-aggregation/rdr_5f70f00a8cc74c509622cac68f63bd94/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}