No article text was recorded for this version.
outcome-based evaluation bias
Version 1 of 1406 papers455 conceptsfrozen 2026-10-04
Papers in this version
- Blog: MR-BEN: A Comprehensive Meta-Reasoning Benchmark for Large Language Models
- Blog: Evaluation Hallucination in Multi-Round Incomplete Information Lateral-Driven Reasoning Tasks
- Blog: A Community-driven vision for a new Knowledge Resource for AI
- Blog: Data for Mathematical Copilots: Better Ways of Presenting Proofs for Machine Learning
- Blog: MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMs
- Blog: From Scores to Steps: Diagnosing and Improving LLM Performance in Evidence-Based Medical Calculations
- Blog: The Lessons of Developing Process Reward Models in Mathematical Reasoning
- Blog: Generative AI Act II: Test Time Scaling Drives Cognition Engineering
- Blog: Milestones over Outcome: Unlocking Geometric Reasoning with Sub-Goal Verifiable Reward
- Blog: LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs
- Blog: Beyond Accuracy: Measuring Bias Acknowledgment in Chain-of-Thought Reasoning for Responsible AI Evaluation
- Blog: StepMathAgent: A Step-Wise Agent for Evaluating Mathematical Processes through Tree-of-Error
- Blog: MMMR: Benchmarking Massive Multi-Modal Reasoning Tasks
- Blog: Shape of Thought: When Distribution Matters More than Correctness in Reasoning Tasks
- Blog: Enhancing LLMs for Physics Problem-Solving using Reinforcement Learning with Human-AI Feedback
- Blog: R3: A Reading Comprehension Benchmark Requiring Reasoning Processes
- Blog: DynaSolidGeo: A Dynamic Benchmark for Genuine Spatial Mathematical Reasoning of VLMs in Solid Geometry
- Blog: The Lessons of Developing Process Reward Models in Mathematical Reasoning
- Blog: Hidden Patterns in Chain-of-Thought Reasoning
- Blog: Evaluating Mathematical Reasoning Beyond Accuracy
- Blog: Benchmarking the Scientific Mind: A Pathology-Derived Biomedical VQA Benchmark for Complex Scientific Reasoning
- Blog: OpenDiscoveryTrace: Process Traces for Evaluating AI Scientist Workflows
- Blog: Examining False Positives under Inference Scaling for Mathematical Reasoning
- Blog: K12Vista: Exploring the Boundaries of MLLMs in K-12 Education
- Blog: Reasoning Segmentation for Images and Videos: A Survey
- Blog: Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions?
- Blog: SAS-Bench: A Fine-Grained Benchmark for Evaluating Short Answer Scoring with Large Language Models
- Blog: PersonaMath: Enhancing Math Reasoning through Persona-Driven Data Augmentation
- Blog: What Defines Good Reasoning in LLMs? Dissecting Reasoning Steps with Multi-Aspect Evaluation
- Blog: MR-BEN: A Comprehensive Meta-Reasoning Benchmark for Large Language Models
- Blog: Debate, Reflect, and Distill: Multi-Agent Feedback with Tree-Structured Preference Optimization for Efficient Language Model Enhancement
- Blog: MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models
- Blog: Debate, Reflect, and Distill: Multi-Agent Feedback with Tree-Structured Preference Optimization for Efficient Language Model Enhancement
- Blog: Towards Rationality in Language and Multimodal Agents: A Survey
- Blog: Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study
- Blog: Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoning
- Blog: A Survey on Large Language Model Benchmarks
- Blog: STREET: A Multi-Task Structured Reasoning and Explanation Benchmark
- Blog: Putnam-AXIOM: A Functional & Static Benchmark for Measuring Higher Level Mathematical Reasoning in LLMs
- Blog: LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs
- Blog: LogiNumSynth: Synthesizing Joint Logical-Numerical Reasoning Problems for Language Models
- Blog: VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
- Blog: PuzzLing Machines: A Challenge on Learning From Small Data
- Blog: MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps
- Blog: MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps
- Blog: Visual Reasoning Tracer: Object-Level Grounded Reasoning Benchmark
- Blog: RealCritic: Towards Effectiveness-Driven Evaluation of Language Model Critiques
- Blog: Beyond Answer Correctness: Measuring and Reducing Explanation Faithfulness Gaps in Chart Understanding VLMs
- Blog: Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus
- Blog: RAVine: Reality-Aligned Evaluation for Agentic Search
- Blog: THiNK: Can Large Language Models Think-aloud?
- Blog: Generative Evaluation of Complex Reasoning in Large Language Models
- Blog: Visual Question Decomposition on Multimodal Large Language Models
- Blog: Diverse Human Value Alignment for Large Language Models via Ethical Reasoning
- Blog: THINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models
- Blog: TD-EVAL: Revisiting Task-Oriented Dialogue Evaluation by Combining Turn-Level Precision with Dialogue-Level Comparisons
- Blog: Characterizing, Evaluating, and Optimizing Complex Reasoning
- Blog: Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models
- Blog: SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problems
- Blog: LogicGame: Benchmarking Rule-Based Reasoning Abilities of Large Language Models
Showing 60 of 406 papers.
History & citation
Current · Permanent link
- Process Oriented Evaluation for Multimodal Reasoning merged into this direction (58% overlap)
- This direction split from Process Based Evaluation of Large Language Model Reasoning (85% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_outcome_based_evaluation_bias_e188b094,
title = {outcome-based evaluation bias},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/outcome-based-evaluation-bias/rdr_e188b09417244a3381df940ad171d191},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_outcome_based_evaluation_bias_e188b094_v1,
title = {outcome-based evaluation bias},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/outcome-based-evaluation-bias/rdr_e188b09417244a3381df940ad171d191/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}