Design and application of coal gangue sorting system based on deep learning

Kun Zhang, Zhen Wang, Zengbao Zhang, Zhiyuan Shi, Yuhao Qi, Mingchao Du, Yong Chen, T Liu, Yumeng Chen, Yin ZhuangScientific 2024 · DOI

TL;DR

Researchers have developed an intelligent, non-contact sorting system that uses ResNet-50 deep learning and high-speed pneumatic cylinders to identify and remove "gangue" (waste rock) from coal. The system achieves over 97% identification accuracy and can complete the entire "see-and-sort" process in under three seconds, significantly outperforming manual labor and traditional robotic arms.

What Problem Does This Paper Address?

In the coal industry, "gangue" is the unwanted rock mixed in with raw coal. Leaving it in reduces combustion efficiency and increases environmental pollution, but removing it is a massive headache.

Traditional methods fall into three categories, each with a "catch":

  1. Manual Picking: High labor intensity and low accuracy.
  2. Mechanical/Wet Sorting: Uses massive amounts of water (dense medium selection) or creates high pollution.
  3. Robotic Arms: While "smart," mechanical arms are often too slow to keep up with high-speed conveyor belts and have high maintenance costs.

The authors aim to bridge this gap by creating a system that is as smart as a human but as fast as a machine, specifically designed for the high-volume, high-speed environment of a modern coal-washing plant.

Methods

The authors proposed a multi-stage "Identification and Sorting" framework:

  • Computer Vision: They utilized transfer learning with a ResNet-50 convolutional neural network. The model was trained to distinguish between coal and gangue based on visual features like contour and texture. A block is classified as gangue if the rock's surface area is more than 50% gangue.
  • Hardware Integration: The system uses an industrial camera array and a high-uniformity light source inside a "darkroom" to capture clear images of the moving belt.
  • Pneumatic Ejection: Instead of a slow robotic gripper, the system uses an array of high-frequency pneumatic cylinders. When gangue is detected, a cylinder "strikes" the rock, knocking it off the main trajectory into a refuse bin.
  • Control Logic: A custom controller (based on the GD32F103RDT6 chip) calculates a precise "strike delay" formula. This formula accounts for the belt speed, the time taken for the AI to "think" (image processing time), and the physical distance between the camera and the cylinders.

Datasets

The paper notes a general lack of diverse, "multi-scene" coal gangue datasets in the industry. For this study:

  • Experimental Set: The authors used a prototype setup with a test flow containing 30% gangue.
  • Samples: Evaluation was performed on 120 gangue samples and 280 coal samples.
  • Particle Size: The dataset focused on rocks with particle sizes ranging from 50 to 120 mm, which is the "sweet spot" for pneumatic sorting.

Key Insights and Ideas

  • Speed Over Dexterity: The most significant "aha" moment is the move away from robotic arms. While arms are versatile, they are a bottleneck on fast belts. The pneumatic "punch" approach is binary and much faster, allowing for a separation time of less than 3 seconds.
  • The "Goldilocks" Size Range: The researchers found that rocks smaller than 50mm often shatter upon impact, while rocks larger than 120mm require more force than a standard cylinder can provide. This defines a clear operational window for the technology.
  • Dynamic Database Construction: The system doesn't just "see" a rock; it constructs a dynamic database of the target's contour, mass, and center of gravity in real-time to ensure the pneumatic strike hits the center of mass for a clean ejection.

Key Results

The prototype was tested at various belt speeds (0.5 m/s to 1.0 m/s) with impressive results:

  • Accuracy: Achieved a peak identification accuracy of 99.2% (at 0.5 m/s) and maintained over 97% even at higher speeds.
  • Sorting Rate: Successfully removed over 91% of the gangue.
  • Efficiency: The system is significantly more energy-efficient than "spray gun" pneumatic methods (which use continuous air) or multi-axis robotic arms.
  • Latency: The time from identification to physical separation is consistently under 3 seconds.

Limitations and Future Work

  • Size Constraints: As noted, the system is currently optimized for the 50–120 mm range. Future iterations would need more powerful actuators for larger rocks or different sensors for fine-grain waste.
  • Environmental Robustness: While the "darkroom" helps, real-world coal mines are incredibly dusty and vibrate heavily. The authors acknowledge that "online recognition theories" need further upgrades to handle extreme motion blur and noise.
  • Dataset Expansion: The authors call for the development of larger, multi-scene datasets to improve the AI's ability to generalize across different types of coal mines globally.

Summary updated

Abstract

With the advancement of science and technology, coal-washing plants are transitioning to intelligent, information-based, and professional sorting systems. This shift accelerates the construction a modern economic system characterized by green and low-carbon development, thereby promoting the high-quality advancement of the coal industry. Traditional manual gangue picking and multi-axis robotic arm gangue selection currently suffer from low recognition accuracy, slow sorting efficiency, and high worker labor intensity. This paper proposes a deep learning-based, non-contact gangue recognition and pneumatic intelligent sorting system. The system constructs a dynamic database containing key feature information such as the target gangue's contour, quality, and center of mass. The system elucidates the relationships between ejection speed, mass, volume, angle of incidence, and the impact energy matching mechanism. Demonstration experiments using the system prototype for coal gangue sorting reveal that, compared to existing robotic arm sorting methods in coal washing plants, this system achieves a gangue identification accuracy exceeding 97%, a sorting rate above 91%, and a separation time of less than 3 s from identification to separation, thereby effectively enhancing raw coal purity.
BibTeX
@inproceedings{zhang2024design,
  author = {Kun Zhang and Zhen Wang and Zengbao Zhang and Zhiyuan Shi and Yuhao Qi and Mingchao Du and Yong Chen and T Liu and Yumeng Chen and Yin Zhuang},
  title = {{Design and application of coal gangue sorting system based on deep learning}},
  booktitle = {Scientific},
  year = {2024},
  doi = {10.1038/s41598-024-67323-z},
}
Figure