A Steel Surface Defect Detection Method Based on Lightweight Convolution Optimization

Cong Chen, Ming Chen, Hoileong Lee, Yan Li, Jiyang YuarXiv 2025 · DOI · arXiv · OpenReview

TL;DR

This paper introduces an improved YOLOv9s model for steel surface defect detection, tackling the challenge of accurately identifying defects of various sizes, especially small ones. By integrating novel modules like SCConv, C3Ghost, and CARAFE, the model significantly boosts detection accuracy and robustness while maintaining efficiency.

What Problem Does This Paper Address?

Detecting defects on steel surfaces is crucial for quality control in manufacturing, but it's a tough problem. Defects come in all shapes and sizes, making traditional image processing methods struggle with accuracy, particularly for small or subtle flaws. Existing deep learning approaches, while better, still face challenges with complex environments and accurately pinpointing these elusive small defects. This paper aims to bridge that gap by enhancing a state-of-the-art object detection model (YOLOv9s) to be more precise and reliable in identifying a wide range of steel surface defects.

Methods

The core of this work is an enhanced YOLOv9s architecture. The authors introduce three key components:

  • SCConv (Spatial and Channel Reconstruction Convolution): This module aims to reduce redundancy in feature maps by reconstructing spatial and channel dimensions. It helps the model focus on important features while discarding less relevant information, leading to better feature representation and efficiency.
  • C3Ghost Module: This module is integrated to improve the model's feature extraction capabilities by reducing redundant computations and the number of parameters. The goal is to make the model more efficient without sacrificing detection accuracy.
  • CARAFE (Content-Aware Re-Assembly of Feature Maps) Upsampling Operator: This replaces traditional upsampling methods. CARAFE dynamically reorganizes feature maps in a content-aware manner, which is crucial for preserving and restoring fine details of defect regions, especially for high-resolution images and small defects.

Datasets

The study utilizes a steel surface defect dataset provided by Northeastern University. This dataset contains 1,800 images, with 300 samples for each of the six defect categories: Crazing, Inclusion, Patches, Pitted Surface, Rolled-in Scale, and Scratches. The dataset is balanced and aims to represent real-world production scenarios. It was split into training, validation, and test sets in a 7:1:2 ratio.

Key Insights and Ideas

  • Modular Enhancement is Key: The paper demonstrates that strategically integrating specialized modules (SCConv, C3Ghost, CARAFE) into a strong baseline like YOLOv9s can yield significant performance gains.
  • Small Defects are Still a Challenge: Even with advanced models, detecting very small defects, especially under challenging conditions like strong illumination or complex textures, remains an area for improvement.
  • Balancing Performance and Efficiency: The proposed model strikes a good balance between detection accuracy (high mAP, precision, recall) and inference speed (FPS), which is critical for practical industrial applications.
  • Content-Aware Upsampling Matters: CARAFE's ability to intelligently reconstruct feature maps is shown to be particularly beneficial for accurately localizing and defining the boundaries of defects.

Key Results

The proposed improved YOLOv9s model achieved a mean average precision ([email protected]) of 79.6%, an increase of 1.5% over the baseline YOLOv9s. Precision also saw a significant improvement, reaching 77.0% (a 6.3% increase). The model demonstrated superior performance across various defect categories, particularly excelling in inclusion and crazing. In visual comparisons, the "Ours" model provided more precise detection boxes and a lower false detection rate compared to other state-of-the-art algorithms.

Limitations and Future Work

The authors acknowledge that the model's accuracy slightly declines when dealing with extremely small defects, especially under strong illumination or complex surface textures. Additionally, the combined modules, while enhancing performance, lead to a marginal increase in inference latency compared to the original YOLOv9s. Future work will focus on optimizing the lightweight structure for even faster inference, exploring multi-scale feature enhancement, adaptive noise suppression, and domain adaptation techniques to further improve detection of extremely small defects and generalization across varied environments.

Summary updated

Abstract

Surface defect detection of steel, especially the recognition of multi-scale defects, has always been a major challenge in industrial manufacturing. Steel surfaces not only have defects of various sizes and shapes, which limit the accuracy of traditional image processing and detection methods in complex environments. However, traditional defect detection methods face issues of insufficient accuracy and high miss-detection rates when dealing with small target defects. To address this issue, this study proposes a detection framework based on deep learning, specifically YOLOv9s, combined with the C3Ghost module, SCConv module, and CARAFE upsampling operator, to improve detection accuracy and model performance. First, the SCConv module is used to reduce feature redundancy and optimize feature representation by reconstructing the spatial and channel dimensions. Second, the C3Ghost module is introduced to enhance the model's feature extraction ability by reducing redundant computations and parameter volume, thereby improving model efficiency. Finally, the CARAFE upsampling operator, which can more finely reorganize feature maps in a content-aware manner, optimizes the upsampling process and ensures detailed restoration of high-resolution defect regions. Experimental results demonstrate that the proposed model achieves higher accuracy and robustness in steel surface defect detection tasks compared to other methods, effectively addressing defect detection problems.
BibTeX
@misc{chen2025steel,
  author = {Cong Chen and Ming Chen and Hoileong Lee and Yan Li and Jiyang Yu},
  title = {{A Steel Surface Defect Detection Method Based on Lightweight Convolution Optimization}},
  year = {2025},
  eprint = {2507.15476},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2507.15476},
}
Figure