Conveyor Belt Deviation Detection for Mineral Mining Applications Based on Attention Mechanism and Boundary Constraints

Long Ma, Jiaming Han, Chong Dong, Ting Fang, Wensheng Liu, Xian-Hua HeSensors 2025 · DOI

TL;DR

This paper introduces an improved U-Net model for detecting conveyor belt deviations in mining operations. By integrating a ResNet encoder, a novel attention mechanism (MASAG), and a specialized boundary loss, the method achieves state-of-the-art accuracy (99.77%) and robust performance across challenging industrial conditions, crucial for preventing material spillage and equipment damage.

What Problem Does This Paper Address?

Conveyor belts are workhorses in mining, but their deviation from the central path is a common and costly problem. This deviation can lead to material spillage, increased wear on the belt and machinery, and even safety hazards. Traditional mechanical anti-deviation devices are reactive and don't provide real-time quantitative measurements. While machine vision has advanced, accurately detecting subtle belt edge movements in complex, often poorly lit, and dusty industrial environments remains a challenge. Existing deep learning methods struggle with precise edge localization and robustness to varying conditions.

Methods

The core of this work is an enhanced U-Net architecture. Here's a breakdown of the key innovations:

  • ResNet34 Encoder: The standard U-Net encoder is replaced with a ResNet34. This leverages ResNet's ability to learn deeper features and mitigate gradient vanishing issues, leading to better feature extraction, especially for complex industrial scenes.
  • Multi-scale Adaptive Guidance Attention (MASAG) Module: This novel module is integrated into the U-Net's skip connections. It fuses low-level detail features from the encoder with high-level semantic features from the decoder. MASAG adaptively learns weights to focus on relevant conveyor belt edge features while suppressing interference from similar objects like idlers, significantly improving edge segmentation accuracy.
  • Region-Boundary Joint Loss Function: To ensure both accurate segmentation of the belt region and precise edge localization, a combined loss function is proposed. It includes Binary Cross-Entropy and Dice loss for region accuracy, augmented with a boundary loss that specifically penalizes errors near the belt edges. This encourages the model to pay more attention to the critical boundary information.
  • Post-processing for Deviation Quantification: After segmentation, Canny edge detection and RANSAC regression are used to refine the belt edges and fit precise lines. A reference line, constructed based on the stable physical positions of idler rollers, is then used to quantitatively measure the belt's deviation.

Datasets

The study utilizes a self-constructed dataset collected from an actual mining site over six months. This dataset comprises 10,000 representative images captured under diverse environmental conditions, including:

  • Normal lighting
  • Strong light interference
  • Rainy conditions
  • Low-light conditions

This dataset is notable for its authentic representation of dynamic and challenging real-world industrial settings, making it a valuable benchmark for evaluating model robustness.

Key Insights and Ideas

  • Attention is Key for Edge Detail: The MASAG module's success highlights how targeted attention mechanisms can bridge the gap between semantic understanding and fine-grained detail extraction, which is crucial for precise edge detection in cluttered environments.
  • Boundary Loss for Precision: Simply optimizing for overall region accuracy isn't enough for deviation detection. The explicit boundary loss is a critical component for achieving the sub-pixel precision needed to accurately measure belt displacement.
  • Idler Rollers as Stable References: Shifting the reference point for deviation measurement from camera-dependent image boundaries to physically stable idler rollers is a clever way to overcome issues caused by non-ideal camera installations and ensure robust measurements.
  • Segmentation Dominance for Accuracy: The results strongly suggest that segmentation-based methods, despite potentially lower frame rates than detection-based ones, offer superior accuracy for tasks requiring precise boundary localization, like conveyor belt deviation detection.

Key Results

The proposed method achieved impressive results:

  • Accuracy: A final accuracy of 99.77% was reported, outperforming the baseline U-Net (99.65%) and other state-of-the-art methods like YOLOv5s (93.105%), UFLD (85.121%), SEU-Net (99.715%), and DeepLabV3+ (99.452%).
  • Robustness: The model demonstrated stable performance across various challenging environmental conditions, including strong light, rain, and low light, with low Mean Square Error (MSE) values.
  • Qualitative Improvements: Visualizations show the proposed method producing smoother, more complete, and accurate edge delineations compared to other approaches, with significantly less adhesion to background elements like idlers.

Limitations and Future Work

The authors acknowledge several areas for improvement:

  • Illumination and Contamination: While robust to many conditions, severe dust or lens contamination could still degrade edge features, impacting deviation estimation stability.
  • Model Complexity and Speed: The current architecture, while accurate, is computationally intensive, leading to relatively low inference speeds. Future work will focus on lightweight network designs and model pruning.
  • Dataset Diversity: The dataset, while comprehensive, was primarily from a single mining site and didn't cover extreme conditions like heavy snow or occlusion. Expanding dataset diversity is crucial for better generalization.
  • Deployment Optimization: While the system can run in real-time on an industrial PC, further optimization for embedded edge devices is needed for broader practical deployment. Future research will explore edge computing and multimodal fusion.

Summary updated

Abstract

To address the issue of material spillage and equipment wear caused by conveyor belt deviation in complex industrial scenarios, this study proposes a detection method based on an improved U-Net. The approach adopts U-Net as the backbone network, with a ResNet34 encoder to enhance feature extraction capability. At the skip connections, a Multi-scale Adaptive Guidance Attention (MASAG) module is embedded to strengthen the fusion of semantic and detailed features. In the loss function design, a boundary loss is incorporated to improve edge segmentation accuracy. Furthermore, the segmentation results are refined via edge detection and RANSAC regression, and a reference line is constructed based on the physical stability of rollers in the image to enable quantitative measurement of deviation. Experiments on a self-constructed dataset demonstrate that the proposed method achieves higher accuracy (99.77%) compared with the baseline U-Net (99.65%) and also surpasses other categories of approaches, including detection-based (YOLOv5s), anchor-point-based (UFLD), and segmentation-based approaches represented by SEU-Net and DeepLabV3+, thereby exhibiting strong robustness and real-time performance across diverse complex operating conditions. The results validate the effectiveness of this method in practical applications and provide a reliable technical pathway for the development of intelligent monitoring systems for mining conveyor belts.
BibTeX
@inproceedings{ma2025conveyor,
  author = {Long Ma and Jiaming Han and Chong Dong and Ting Fang and Wensheng Liu and Xian-Hua He},
  title = {{Conveyor Belt Deviation Detection for Mineral Mining Applications Based on Attention Mechanism and Boundary Constraints}},
  booktitle = {Sensors},
  year = {2025},
  doi = {10.3390/s25226945},
}
Figure