No article text was recorded for this version.
distributional alignment metrics
Version 1 of 144 papers60 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification
- Blog: Stop Measuring Calibration When Humans Disagree
- Blog: Mind the Uncertainty in Human Disagreement: Evaluating Discrepancies Between Model Predictions and Human Responses in VQA
- Blog: Training Affective Computer Vision Models by Crowdsourcing Soft-Target Labels
- Blog: Every Opinion Matters: Evaluating and Building Models with Pluralistic Views
- Blog: Lost in Inference: Rediscovering the Role of Natural Language Inference for Large Language Models
- Blog: The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labels
- Blog: Beyond correlation: The impact of human uncertainty in measuring the effectiveness of automatic evaluation and LLM-as-a-judge
- Blog: Every Answer Matters: Evaluating Commonsense with Probabilistic Measures
- Blog: Ambiguous Medical Image Segmentation Using Diffusion Schrödinger Bridge
- Blog: VisAlign: Dataset for Measuring the Alignment between AI and Humans in Visual Perception
- Blog: Learning from Disagreement: A Survey
- Blog: Simulating the Behaviour of Older versus Younger Users when Interacting with Spoken Dialogue Systems
- Blog: A Matter of Interest: Understanding Interestingness of Math Problems in Humans and Language Models
- Blog: Validating LLM-as-a-Judge Systems under Rating Indeterminacy
- Blog: Modeling Semantic Expectation: Using Script Knowledge for Referent Prediction
- Blog: Ambiguous Images With Human Judgments for Robust Visual Event Classification
- Blog: Can Modelling Inter-Rater Ambiguity Lead To Noise-Robust Continuous Emotion Predictions?
- Blog: Discrete Choice Models for Non-Intrusive Quality Assessment
- Blog: Offensiveness as an Opinion: Dissecting population-level Label Distributions
- Blog: A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
- Blog: Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference
- Blog: Cloze Distillation: Improving Neural Language Models with Human Next-Word Prediction
- Blog: Modeling Open World Cognition as On-Demand Synthesis of Probabilistic Models
- Blog: Beyond Averages: Learning with Annotator Disagreement in STS
- Blog: Are Large Language Models Chameleons?
- Blog: Maximizing Signal in Human-Model Preference Alignment
- Blog: Teaching Large Language Models to Regress Accurate Image Quality Scores Using Score Distribution
- Blog: What Can We Learn from Collective Human Opinions on Natural Language Inference Data?
- Blog: Multi-scored sleep databases: how to exploit the multiple-labels in automated sleep scoring
- Blog: SemEval-2021 Task 12: Learning with Disagreements
- Blog: The "Problem" of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
- Blog: Multi-Dimensional, Nuanced and Subjective - Measuring the Perception of Facial Expressions
- Blog: Distributional LLM-as-a-Judge
- Blog: Inflecting When There's No Majority: Limitations of Encoder-Decoder Neural Networks as Cognitive Models for German Plurals
- Blog: Modeling Semantic Expectation: Using Script Knowledge for Referent Prediction
- Blog: Arbiters of Ambivalence: Challenges of using LLMs in No-Consensus tasks
- Blog: What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability
- Blog: Perspectives in Play: A Multi-Perspective Approach for More Inclusive NLP Systems
- Blog: Is one annotation enough? - A data-centric image classification benchmark for noisy and ambiguous label estimation
- Blog: User simulation for spoken dialogue systems: learning and evaluation
- Blog: Beyond Words: Exploring Cultural Value Sensitivity in Multimodal Models
- Blog: Mining the uncertainty patterns of humans and models in the annotation of moral foundations and human values
- Blog: Performance of Conformal Prediction in Capturing Aleatoric Uncertainty
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_distributional_alignment_metrics_67369816,
title = {distributional alignment metrics},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/distributional-alignment-metrics/rdr_67369816d667462bbc0aa7b7f0b5ee4f},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_distributional_alignment_metrics_67369816_v1,
title = {distributional alignment metrics},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/distributional-alignment-metrics/rdr_67369816d667462bbc0aa7b7f0b5ee4f/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}