RoBiS: Robust Binary Segmentation for High-Resolution Industrial Images

Xurui Li, Zhonesheng Jiang, Tingxuan Ai, Yu ZhouarXiv 2025 · DOI · arXiv

TL;DR

RoBiS is a new framework designed to tackle the "messy" reality of industrial anomaly detection, where high-resolution images and unpredictable lighting often break standard models. By combining a smart cropping strategy, lighting-aware data augmentation, and a refinement stage using the Segment Anything Model (SAM), RoBiS achieves a massive ~29% improvement in segmentation performance on the challenging MVTec AD 2 benchmark.

What Problem Does This Paper Address?

In the controlled environment of a research lab, unsupervised anomaly detection (AD) — finding defects using only "normal" training data — looks like a solved problem, with many models hitting >99% accuracy. However, real-world industrial inspection is a different beast.

The authors highlight two major "walls" that current models hit:

  1. The Resolution Paradox: Industrial images are often massive (2K+ resolution), but defects can be tiny (sometimes just 5 pixels). Standard models usually downsample images to fit into memory, which effectively "erases" these small anomalies.
  2. Environmental Volatility: Real factories have sensor noise, shifting viewpoints, and extreme lighting changes (like dark-field or backlighting). Most AD models are "brittle"—they perform well under perfect lights but fail when the environment shifts even slightly.

Methods

The authors propose RoBiS (Robust Binary Segmentation), a multi-stage framework built on three core pillars:

  • Swin-Cropping: Instead of resizing the whole image, RoBiS uses a sliding window (1024x1024) with a 10% overlap. This ensures that even if a defect falls on the edge of a crop, it is captured in full in the adjacent window, preserving the "fine-grained" details of tiny anomalies.
  • Robust Data Augmentation: To prepare the model for the "real world," the researchers injected Gaussian noise and simulated exposure variations (overexposure and underexposure) during training. This forces the underlying model (they used INP-Former as a baseline) to learn features that are invariant to lighting shifts.
  • Adaptive Binarization & SAM-Finer: Most AD models produce a "heat map" of probabilities. Turning that into a crisp "defect vs. no defect" mask is notoriously hard. RoBiS uses a hybrid approach:
  • It combines traditional statistics (mean + 3 standard deviations) with a specialized module called MEBin.
  • It then uses the Segment Anything Model (SAM) as a "polisher." By feeding the coarse detection into SAM as a prompt, the system can snap the boundaries of the defect to the actual object edges, significantly cleaning up the final mask.

Datasets

The study focuses exclusively on the MVTec AD 2 dataset. This is a rigorous benchmark containing 8,004 high-resolution images across eight industrial categories (e.g., Wall Plugs, Walnuts, Fruit Jelly, Sheet Metal).

Unlike its predecessor, MVTec AD 2 includes a "Mixed" test set specifically designed to simulate real-world uncertainties, making it the current gold standard for testing robustness in industrial AI.

Key Insights and Ideas

  • Binarization is the "Last Mile" Problem: The authors argue that generating a good anomaly map is only half the battle. If your thresholding strategy is too rigid, you either get too much noise or miss subtle defects. Their hybrid adaptive approach acknowledges that "one size does not fit all" for different materials.
  • Foundation Models as Refiners: A standout idea is using SAM not as the primary detector, but as a post-processing tool. Since SAM is trained on millions of natural images, it has an excellent "sense" of object boundaries, which helps correct the fuzzy edges often produced by AD heat maps.
  • Overlap is Essential: The 10% overlap in Swin-Cropping isn't just a detail; it’s a safeguard. Without it, a defect split across two crops might not look "anomalous" enough in either, leading to a false negative.

Key Results

The performance gains are substantial. On the MVTec AD 2 "Private" test set, RoBiS achieved:

  • SegF1 Score: 51.00%, a 29.2% absolute improvement over previous state-of-the-art methods (which hovered around 21.8%).
  • Mixed Test Set: On the even harder "Mixed" set (with unseen lighting), it reached 46.52%, up from 16.7%.

Qualitatively, the framework showed exceptional performance on complex textures like Fabric (87.46% SegF1) and Sheet Metal (70.98% SegF1), where traditional methods often struggle to distinguish between normal texture and actual scratches.

Limitations and Future Work

Despite the success, the authors note a few hurdles:

  • Computational Cost: Processing high-resolution images via overlapping crops and then running SAM for refinement is computationally expensive. This might limit its use in ultra-high-speed production lines without further optimization.
  • SAM’s Resolution Limit: SAM’s internal feature resolution (64x64) can still be a bottleneck for extremely slender or microscopic anomalies, sometimes leading to masks that are slightly larger than the actual defect.
  • Inference Speed: Future work will likely focus on making this pipeline more efficient, perhaps by distilling the knowledge of the SAM-refinement stage back into a faster, single-pass model.

Summary updated

Abstract

Robust unsupervised anomaly detection (AD) in real-world scenarios is an important task. Current methods exhibit severe performance degradation on the MVTec AD 2 benchmark due to its complex real-world challenges. To solve this problem, we propose a robust framework RoBiS, which consists of three core modules: (1) Swin-Cropping, a high-resolution image pre-processing strategy to preserve the information of small anomalies through overlapping window cropping. (2) The data augmentation of noise addition and lighting simulation is carried out on the training data to improve the robustness of AD model. We use INP-Former as our baseline, which could generate better results on the various sub-images. (3) The traditional statistical-based binarization strategy (mean+3std) is combined with our previous work, MEBin (published in CVPR2025), for joint adaptive binarization. Then, SAM is further employed to refine the segmentation results. Compared with some methods reported by the MVTec AD 2, our RoBiS achieves a 29.2% SegF1 improvement (from 21.8% to 51.00%) on Test_private and 29.82% SegF1 gains (from 16.7% to 46.52%) on Test_private_mixed. Code is available at https://github.com/xrli-U/RoBiS.
BibTeX
@misc{li2025robis,
  author = {Xurui Li and Zhonesheng Jiang and Tingxuan Ai and Yu Zhou},
  title = {{RoBiS: Robust Binary Segmentation for High-Resolution Industrial Images}},
  year = {2025},
  eprint = {2505.21152},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2505.21152},
  howpublished = {arXiv},
}
Figure