Progressive Boundary Guided Anomaly Synthesis for Industrial Anomaly Detection

Qiyu Chen, Huiyuan Luo, Han Gao, Chengkan Lv, Zhengtao Zhang

TL;DR

The authors propose Progressive Boundary-guided Anomaly Synthesis (PBAS), a novel unsupervised method for industrial anomaly detection that synthesizes artificial anomalies directly in the feature space. By iteratively refining a decision boundary and generating "near-in-distribution" anomalies along specific ray directions, PBAS achieves state-of-the-art accuracy and industry-leading inference speeds (75 FPS) without requiring any auxiliary datasets for textures.

What Problem Does This Paper Address?

Unsupervised Anomaly Detection (UAD) is critical for industrial quality control because real-world defects are rare and unpredictable. Most UAD models are trained only on "normal" samples, which often leads to overfitting—the model becomes so specialized in recognizing normal patterns that it fails to distinguish subtle deviations.

To combat this, researchers often synthesize artificial anomalies. However, current methods have two major drawbacks:

  1. Image-level synthesis (e.g., CutPaste, NSA) relies heavily on external datasets to provide anomalous textures, which may not match the target domain.
  2. Feature-level synthesis (e.g., SimpleNet) often adds random Gaussian noise to normal features. This noise lacks directionality and can result in synthetic anomalies that still overlap with the normal data distribution, leading to "loose" and ineffective decision boundaries.

Methods

PBAS introduces a three-stage progressive strategy to learn a tight, discriminative boundary around normal data:

  1. Approximate Boundary Learning (ABL): Instead of simple averaging to find a "center" for normal data (like traditional SVDD), ABL uses a novel iterative feature alignment method. This captures the intra-class diversity of normal samples more accurately, establishing a compact hypersphere as an initial, "loose" boundary.
  2. Anomaly Feature Synthesis (AFS): This is the core innovation. Rather than adding random noise, AFS synthesizes anomalies along a ray direction starting from the hypersphere center and passing through a normal feature point. This ensures anomalies are generated just outside the normal distribution along the most efficient path. The synthesis scale is self-adaptive, based on the average distance of features from the center.
  3. Refined Boundary Optimization (RBO): Finally, a discriminator (a simple MLP) is trained to perform binary classification between the normal features and the AFS-generated anomalies. This process "shrinks" and refines the boundary, effectively separating normal data from potential defects without any overlapping regions.
Mechanism of self-adaptive generation and progressive boundary guidance.

Datasets

The authors evaluated PBAS on three standard industrial benchmarks:

  • MVTec AD: 15 categories of industrial products with over 70 types of defects.
  • VisA: A large-scale dataset featuring 12 categories of complex industrial parts.
  • MPDD: Specifically focused on metal parts under varied camera conditions and shooting angles.

Key Insights and Ideas

  • Directionality Matters: Synthesizing anomalies in a "ray direction" (from the center through a normal point) is far more effective than random Gaussian noise. It targets the specific areas where the model is most likely to be confused.
  • Iterative Center Initialization: Traditional methods often collapse all normal features to a single point. PBAS’s iterative alignment (shown in Figure 4) allows the center to represent the "essence" of the normal class while respecting its natural variations.
  • Progressive Refinement: The transition from a loose hypersphere (ABL) to a refined discriminative boundary (RBO) mimics a "coarse-to-fine" learning process that is highly robust against the lack of real anomalous data.
Conceptual illustration of the PBAS pipeline from dispersed features to refined boundaries.

Key Results

PBAS sets a new bar for both performance and efficiency:

  • Accuracy: Achieved an average I-AUROC of 99.8% on MVTec AD, outperforming existing SOTA methods like SimpleNet and RD++. It achieved a perfect 100% score on 9 out of 15 categories.
  • Localization: On the VisA dataset, it improved the P-AP (Pixel-level Average Precision) by 5.4% over the previous best method, demonstrating a superior ability to detect tiny, subtle anomalies.
  • Speed: Despite the sophisticated training strategy, the inference architecture is streamlined. It reaches 75 FPS on an NVIDIA RTX 3090, making it highly suitable for real-time industrial deployment.

Limitations and Future Work

The authors note that PBAS is primarily designed for structural anomalies (like scratches, stains, or cracks). It currently struggles with logical anomalies—cases where the components themselves are normal, but their arrangement is wrong (e.g., a missing screw or a misaligned part). These require a higher-level semantic understanding of the scene. The authors plan to explore the integration of semantic analysis to tackle these logical defects in future work.

The code is available at: https://github.com/cqylunlun/PBAS

Summary updated

Abstract

Unsupervised anomaly detection methods can identify surface defects in industrial images by leveraging only normal samples for training. Due to the risk of overfitting when learning from a single class, anomaly synthesis strategies are introduced to enhance detection capability by generating artificial anomalies. However, existing strategies heavily rely on anomalous textures from auxiliary datasets. Moreover, their limitations in the coverage and directionality of anomaly synthesis may result in a failure to capture useful information and lead to significant redundancy. To address these issues, we propose a novel Progressive Boundary-guided Anomaly Synthesis (PBAS) strategy, which can directionally synthesize crucial feature-level anomalies without auxiliary textures. It consists of three core components: Approximate Boundary Learning (ABL), Anomaly Feature Synthesis (AFS), and Refined Boundary Optimization (RBO). To make the distribution of normal samples more compact, ABL first learns an approximate decision boundary by center constraint, which improves the center initialization through feature alignment. AFS then directionally synthesizes anomalies with more flexible scales guided by the hypersphere distribution of normal features. Since the boundary is so loose that it may contain real anomalies, RBO refines the decision boundary through the binary classification of artificial anomalies and normal features. Experimental results show that our method achieves state-of-the-art performance and the fastest detection speed on three widely used industrial datasets, including MVTec AD, VisA, and MPDD. The code will be available at: https://github.com/cqylunlun/PBAS.
BibTeX
@article{chen2024progressive,
  author = {Qiyu Chen and Huiyuan Luo and Han Gao and Chengkan Lv and Zhengtao Zhang},
  title = {{Progressive Boundary Guided Anomaly Synthesis for Industrial Anomaly Detection}},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  url = {https://openreview.net/forum?id=njvA9r7EYt},
}
Figure