CASCADE: Constraint-Aware SCAffolded DEcomposition for Logical Anomaly Detection

Jinchan Kim, Jinhee Im, Hyunsouk ChoarXiv 2026 · arXiv

TL;DR

CASCADE is a training-free framework that enables Large Vision-Language Models (LVLMs) to perform Logical Anomaly Detection with state-of-the-art accuracy using only a few reference images. By identifying a "perception gap" in how models view raw images, the authors introduce constraint-specific visual scaffolds—like per-object coloring and calibrated grids—to make logical evidence explicit and bridge the gap between text reasoning and visual perception.

What Problem Does This Paper Address?

In manufacturing, Logical Anomaly Detection (LAD) goes beyond finding simple surface defects like cracks or scratches. It requires verifying complex rules: "Are there exactly two pins in this slot?" or "Is this cable the same length as the reference?"

While Large Vision-Language Models (LVLMs) are great at following instructions, they often fail at LAD because they struggle to perceive fine-grained details in raw images. Current methods try to solve this by breaking down a task into a textual "checklist," but they still feed the same unmodified image to the model for every check. This leads to two major failure modes:

  1. Instance Conflation: The model loses track of visually similar objects (e.g., it can't distinguish between five identical screws).
  2. Scale Drift: The model lacks an absolute sense of scale, making its measurements inconsistent across different images.

Methods

The authors propose CASCADE (Constraint-Aware SCAffolded DEcomposition), a framework that adapts the visual input to match the specific logical constraint being checked.

Fig. 2: Method comparison between the baseline and CASCADE. Both methods use checklist generator and checklist verifier for verdicts. Unlike the baseline, ours overlays a constraint-specific scaffold on the query image, so each constraint is verified with an adapted visual input.

The core innovation is the use of visual scaffolds:

  • Binding Scaffolds: For counting or pairing tasks, CASCADE uses a segmentation model (SAM3) to find objects and then overlays distinct colors and numeric IDs on each one. This prevents the model from "conflating" identical items.
  • Alignment Scaffolds: For measurement tasks, it overlays an object-anchored 2D grid.
  • CASCADE++: This enhanced version automatically configures the scaffolds. It derives ID numbering from the logical structure of the constraint and calibrates grid cell widths based on the distribution of "normal" measurements found in a few reference images.

Datasets

The researchers evaluated their method on two key benchmarks:

  • MVTec-LOCO: The standard dataset for logical anomaly detection, featuring five product categories with complex structural and logical rules.
  • VID-AD: A more challenging dataset that includes "distractions" like low-light conditions, motion blur, and varying backgrounds (mesh, cable, etc.).

Key Insights and Ideas

  • Perception is the Bottleneck: The authors proved that the problem isn't the model's "thinking" (reasoning) but its "seeing" (perception). Adding reasoning guides like Chain-of-Thought barely improved performance, whereas changing the image with a scaffold led to massive gains.
  • The "Magic Number" 10: Without help, LVLMs' counting accuracy collapses when there are more than ~10 identical objects. Visual scaffolds keep this accuracy stable even as the number of objects increases.
  • Explicit Evidence: By adding a grid or a color, the "evidence" for a violation becomes a simple visual fact (e.g., "the bolt ends in cell 4, but references end in cell 3") rather than an abstract judgment.
Fig. 1: Checklist verification on a raw query versus a scaffolded query—per-instance coloring for counting, an object-anchored grid for measurement. Both are the same image verified against the same checklist item, and both violate their constraint, yet only the scaffolded query yields the correct verdict. The Measurement condition is defined by the K = 3 references shown in the band rather than stated explicitly (Section VII-B).

Key Results

CASCADE++ achieved impressive results without any task-specific training:

  • MVTec-LOCO: Reached 93.2 AUROC, surpassing the previous full-shot state-of-the-art (which uses the entire training set) by 3.9 points, while using only three reference images.
  • VID-AD: Outperformed the strongest baseline by 11.4 points, showing remarkable robustness to poor lighting and blur.
  • Cross-Model Transfer: The scaffolding technique worked consistently across different model backbones, including GPT-5-image-mini, Gemini-3.1-Flash, and Qwen3-VL.
Fig. 3: Comparison of textual reasoning and visual perception guides. Bars show balanced accuracy on a binding constraint for Counting and the average over calibration constraints for Measurement, with the dashed lines indicating the text-only baselines. Each overlay is applied to both constraint types, not only the one it was designed for.

Limitations and Future Work

While highly effective, CASCADE++ has some trade-offs:

  • Inference Speed: Because it makes multiple LVLM calls (one per constraint), it is slower than traditional feature-based detectors. It is better suited for "near-line" inspection rather than high-speed "in-line" control.
  • Segmentation Dependency: The quality of the scaffolds depends on the underlying segmentation model (SAM3). If the model fails to find an object, the scaffold will be misplaced.
  • Complex Constraints: Future work could explore constraints that require both counting and measuring simultaneously, which might require more complex, multi-layered scaffolds.

Summary updated

Abstract

Logical Anomaly Detection (LAD) requires verifying whether all category-specific constraints, such as object counts, pairing relations, and measurement ranges, are satisfied by a query image given only a few normal references. Recent LAD methods based on Large Vision-Language Models (LVLMs) formulate this as checklist verification, decomposing the decision into independent textual checks. This decomposition, however, is text-only. Every item still reads the same unmodified query image, so the LVLM must extract different forms of visual evidence from one raw image. We identify this text-image mismatch as a constraint-specific perception gap, the source of two failure modes: instance conflation for binding constraints and scale drift for calibration constraints. To diagnose whether these failures stem from insufficient reasoning or insufficient perception, we compare textual reasoning guides and visual perception guides in a training-free setting. Our analysis shows that reasoning over the same image provides little benefit, whereas adapting the visual input to each constraint substantially improves verification accuracy. Based on this finding, we propose CASCADE, a training-free framework that extends checklist decomposition using constraint-specific visual scaffolds. We further introduce CASCADE++, which adapts these scaffolds at the object level by deriving their configurations from the constraint structure and reference distribution. Across MVTec-LOCO and VID-AD, CASCADE++ surpasses the full-shot state of the art by 3.9 AUROC points with only three references, and improves over the strongest VID-AD baseline by 11.4, transferring across multiple LVLM backbones without any training.
BibTeX
@misc{kim2026cascade,
  author = {Jinchan Kim and Jinhee Im and Hyunsouk Cho},
  title = {{CASCADE: Constraint-Aware SCAffolded DEcomposition for Logical Anomaly Detection}},
  year = {2026},
  eprint = {2611.13820},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.13820},
}
Figure