Diagnosing Reasoning Failures through Fine-Grained Error Taxonomies

This direction is merged into another direction: hallucination taxonomy. Its last version stays readable and citable here.

Version 1 of 1688 papers775 conceptsfrozen 2026-10-04

For years, the progress of Large Language Models (LLMs) was measured by a single, binary yardstick: accuracy. A model either got the answer right, or it got it wrong. However, as models tackle increasingly complex tasks—from multi-step calculus to competitive programming—this "pass/fail" approach has become a bottleneck. Knowing that a model failed is no longer enough; we need to know why it failed.

A growing body of research is shifting the focus from aggregate scores to fine-grained error taxonomies. By decomposing "hallucinations" and reasoning slips into specific, observable failure modes, researchers are moving toward a "diagnostic" era of AI development.

The Anatomy of a Hallucination

The term "hallucination" is often used as a catch-all for any incorrect output. However, Ziwei Ji 0001 and colleagues in their Survey of Hallucination in Natural Language Generation argue for a more precise distinction: intrinsic vs. extrinsic hallucinations.

An intrinsic hallucination is a logical contradiction of the provided input (e.g., the prompt says "the cat is red," but the model says "the cat is blue"). An extrinsic hallucination involves generating information that cannot be verified from the source. This distinction is crucial because it separates failures in context processing from failures in factual grounding.

Building on this, Vipula Rawte and their team proposed a three-dimensional taxonomy—Orientation, Category, and Degree—in The Troubling Emergence of Hallucination in Large Language Models. This framework allows researchers to rank models not just on how often they lie, but on the severity and type of those lies, using metrics like the Hallucination Vulnerability Index (HVI).

The Familiarity Gap: Knowledge vs. Logic

One of the most counterintuitive findings in recent error analysis is the "familiarity gap." Navita Goyal, Ani Nenkova, and Hal Daumé III discovered that models often generate "nonfactual" errors that are contextually plausible but factually false, particularly for obscure entities.

This suggests a dissociation between two cognitive-like functions:

  1. Factuality: The ability to recall internal knowledge.
  2. Incongruity: The ability to select facts relevant to the current narrative.

As Jie Huang points out in Why Does ChatGPT Fall Short in Answering Questions Faithfully?, many errors stem not from a total lack of knowledge, but from a failure to recall it under specific constraints. By categorizing failures into dimensions like comprehension, specificity, and inference, we can see that a model might "know" a fact but lack the "logical literacy" to apply it.

Local Slips and Global Collapses

In multi-step reasoning, an error is rarely an isolated event. Nouha Dziri and Ximing Lu demonstrate in Faith and Fate: Limits of Transformers on Compositionality that Transformers often solve problems by matching subgraphs of training data rather than following systematic rules. This leads to a specific taxonomy of chain-of-thought failures:

  • Local Step Failures: A single calculation or factual error.
  • Propagation Errors: A correct step based on a previous incorrect one, leading the model further astray.
  • Restoration Errors: A "lucky" correct final answer despite broken intermediate logic.

To debug these chains, William W. Cohen introduced Program Trace Prompting (PTP), which treats reasoning like code execution. By distinguishing between local errors (isolated facts) and non-local errors (step sequencing), researchers can identify whether a model is suffering from a "memory swap" (similar to human working memory errors described by Pat Hanrahan) or a fundamental breakdown in algorithmic strategy.

From Diagnosis to Targeted Remediation

Why does this granular classification matter? Because it enables targeted feedback.

Generic self-correction—simply telling a model to "try again"—is often ineffective. However, the Multi-Aspect Feedback (MAF) framework by Deepak Nathani and colleagues shows that if you decouple error detection into categories like math, logic, and syntax, you can apply specialized tools to each.

Similarly, Yongqi Tong and their team developed COTERRORSET, a dataset of 600,000 reasoning errors. By training models on a taxonomy of "what not to do"—distinguishing between logical, linguistic, and calculation-based mistakes—they found that models could learn to introspect and avoid specific failure modes more effectively than by learning from perfect examples alone.

The Future of Benchmarking

We are seeing a new generation of benchmarks that incorporate these taxonomies into their core design. MM-MATH (Yushi Bai et al.) uses an "LMM-as-a-judge" to pinpoint whether a failure is due to visual misinterpretation or logical reasoning. CriticBench (Zicheng Lin et al.) evaluates the full cycle of generation, critique, and correction, revealing that a model's ability to spot a specific type of error (like a logic slip) does not always correlate with its ability to fix it.

By moving away from monolithic accuracy scores and toward these multi-dimensional diagnostic frameworks, the field is gaining the precision needed to move LLMs from "stochastically plausible" to "verifiably reliable."

Papers in this version

Showing 60 of 688 papers.

History & citationVersion 1 · 2026-10-04

Merged into another direction · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_diagnosing_reasoning_failures_through_fi_9d5b397b,
  title = {Diagnosing Reasoning Failures through Fine-Grained Error Taxonomies},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/diagnosing-reasoning-failures-through-fine-grained-error-taxonomies/rdr_9d5b397b36d247c6bbe81b93995bf946},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}

This exact version (version 1, frozen text):

@misc{lacuna_diagnosing_reasoning_failures_through_fi_9d5b397b_v1,
  title = {Diagnosing Reasoning Failures through Fine-Grained Error Taxonomies},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/diagnosing-reasoning-failures-through-fine-grained-error-taxonomies/rdr_9d5b397b36d247c6bbe81b93995bf946/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}