Consistency-based anomaly detection with adaptive multiple-hypotheses predictions

Duc Tam Nguyen, Zhongyu Lou, Michael Klar, Thomas Brox

Introduction

Anomaly detection is a fundamental task in machine learning, typically framed as a "one-class learning" problem. In scenarios like industrial inspection, models are trained on abundant "normal" data to identify rare deviations. Generative models, such as Variational Autoencoders (VAEs), are common choices: they learn the distribution of normal data and flag samples with high reconstruction error as anomalies.

However, standard autoencoders struggle with multi-modal data distributions. For example, a metal surface might have several valid textures. When faced with multiple "normal" modes, standard models often suffer from mean regression, producing a blurry average of these modes. This blurriness assigns high likelihood to non-existent "average" states while potentially penalizing valid, sharp images, thereby degrading detection performance.

The ConAD Framework

To address these limitations, this paper introduces ConAD (Consistency-based Anomaly Detection), a framework designed to capture complex, multi-modal distributions through a multi-hypotheses approach.

Multi-Hypotheses Architecture

Instead of a single reconstruction, the ConAD decoder utilizes $H$ distinct "heads." Each head generates a potential reconstruction, effectively providing multiple hypotheses for the input data.

Adaptive Learning via Winner-Takes-All (WTA) Loss

To encourage specialization among the decoder heads, the authors employ a Winner-Takes-All (WTA) loss. During training, only the head that produces the reconstruction closest to the ground truth receives a gradient update. This mechanism allows different heads to specialize in specific clusters or "modes" of the normal data manifold.

Discriminator as a Quality Critic

While WTA loss enables specialization, it can lead to "dead" heads or the creation of unrealistic "artificial modes." To counter this, a discriminator is introduced to act as a critic. This component ensures that all generated hypotheses remain within the manifold of realistic data and encourages diversity among the heads, preventing mode collapse.

Figure 1: Conceptual comparison of anomaly detection strategies. Standard autoencoders (b) often over-generalize across modes, whereas the proposed multi-hypotheses model (e) accurately captures local data distributions.

Experimental Evaluation

The authors evaluated ConAD on both benchmark and real-world datasets.

CIFAR-10 Benchmark

Using a standard protocol where one class is treated as "normal" and the others as "anomalies," ConAD achieved an average AUROC of 67.1%. This outperforms several deep learning baselines, including AnoGAN (61.2%) and ADGAN (62.0%).

Industrial Metal Anomaly Detection

The model's strengths were most evident in a real-world industrial dataset featuring structured metal surfaces. These surfaces contain complex textures where anomalies like scratches or dents must be identified against a multi-modal background.

Figure 2: Examples of test images from the Metal Anomaly Dataset. Red boxes highlight subtle defects like scratches and texture irregularities that the model must detect.

In this task, ConAD reduced the error rate significantly from 6.8% to 1.5%. Qualitatively, the model produces sharper reconstructions compared to standard VAEs, leading to clearer anomaly heatmaps and more precise defect localization.

Conclusion

ConAD demonstrates that breaking a global density estimation problem into multiple local hypotheses significantly improves anomaly detection in multi-modal environments. By combining a multi-headed decoder with a discriminator-based critic, the framework avoids the pitfalls of mean regression and blurry reconstructions. Future work will focus on improving the model's robustness to label noise, where anomalies might be inadvertently included in the training set.

Summary updated

BibTeX
@misc{nguyen2018consistency,
  author = {Duc Tam Nguyen and Zhongyu Lou and Michael Klar and Thomas Brox},
  title = {{Consistency-based anomaly detection with adaptive multiple-hypotheses predictions}},
  year = {2018},
  eprint = {1810.13292},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1810.13292},
}

Loading related content...

Figure