Faster OreFSDet: A lightweight and effective few-shot object detector for ore images

Yang Zhang, Le Cheng, Yuting Peng, Chengming Xu, Yanwei Fu, Bo Wu, Guodong Sun

TL;DR

Faster OreFSDet is a specialized, lightweight few-shot object detector designed to identify ore particle sizes in mining environments where labeled data is scarce. By moving away from heavy traditional architectures, the authors achieved a model that is only 19MB in size and runs at 50 FPS, significantly outperforming existing few-shot methods in both accuracy and deployment efficiency.

What Problem Does This Paper Address?

In the mining industry, measuring the size of ore particles is critical for optimizing crushing processes. While deep learning has revolutionized object detection, it faces two major hurdles in this field:

  1. Data Scarcity: Labeling thousands of ore images is expensive and time-consuming. Standard detectors overfit when trained on just a few samples.
  2. Deployment Constraints: Existing Few-Shot Object Detection (FSOD) models are typically built on the "Faster R-CNN" framework. These are often too slow and memory-intensive for real-time use on edge devices at a beneficiation site.

The authors aim to bridge this gap by creating a model that learns from only a handful of examples (few-shot) while remaining fast enough for real-world, real-time deployment.

Methods

The researchers replaced the standard Faster R-CNN backbone with CenterNet2, a more efficient two-stage detector that generates higher-quality proposals with fewer candidates (256 vs. 1000). On top of this, they introduced three novel modules:

  • Support Feature Mining (SM) Block: Instead of using raw support images, this block uses linear projections to encode features along height and width dimensions. This helps the model focus on the most important "position-sensitive" information while filtering out background noise.
  • Relationship Guidance (RG) Block: This module establishes a stronger link between the "support" (the example image) and the "query" (the image being searched). It uses multi-scale kernels (1x1 and 3x3) to capture both spatial and channel-wise correlations, ensuring the model doesn't lose support information during the search.
  • Dual-scale Semantic Aggregation (DSA) Module: Since ore comes in various sizes, this module retrieves features at two different resolutions (4x4 and 8x8) during the final prediction stage to ensure both small and large particles are detected accurately.

Datasets

  • MS COCO: Used for "base training" to give the model a general understanding of what objects look like.
  • Ore Image Dataset: A custom dataset collected from an experimental platform featuring ores of different densities and sizes. The model was fine-tuned on this dataset using only 5, 15, or 25 labeled samples ("shots").

Key Insights and Ideas

  • Efficiency over Complexity: The shift to CenterNet2 is the "aha moment" for speed. By using a probabilistic first stage, the model needs far fewer proposals to achieve high accuracy, which directly reduces the computational burden.
  • Location Matters: In many FSOD tasks, global average pooling is used, which squashes spatial information. The authors realized that for ores—which often overlap or adhere to one another—preserving the spatial relationship (via the SM Block) is vital for distinguishing individual particles.
  • Scale Diversity: Ores aren't uniform. By aggregating features at two different scales (DSA), the model avoids the common pitfall where a detector tuned for large objects misses the small ones, or vice versa.

Key Results

Faster OreFSDet sets a new benchmark for industrial few-shot detection:

  • Accuracy: On the 25-shot ore task, it achieved 54.1 AP, vastly outperforming the baseline AttentionRPN (30.8 AP) and even beating general object detectors like YOLOF (46.8 AP) which were trained on much more data.
  • Speed: It achieves 50 FPS, making it viable for real-time conveyor belt monitoring.
  • Compactness: The model size is a mere 19MB, the smallest among all compared methods (for context, standard Faster R-CNN is ~264MB).
  • Memory: It uses significantly less inference memory (1059MB) compared to other FSOD methods like MPSR (~3821MB).

Limitations and Future Work

While highly effective, the paper focuses primarily on a single-class problem (ore). In more complex mining environments, there might be a need to distinguish between different types of minerals or waste rock simultaneously.

The authors suggest that future work will involve:

  • Extending the framework to Few-Shot Instance Segmentation (not just boxes, but precise outlines of each ore).
  • Exploring One-Shot Detection, where the model learns from a single example image.
  • Developing new mechanisms to further strengthen the correlation between support and query features.

Summary updated

Abstract

Highlights•A lightweight and effective few-shot detector is designed to address the over-fitting issue under limited labeled data for ore particle detection.•We introduce a support feature mining block to characterize the importance of semantic information.•A relationship guidance block is used to establish the correlation between support and query features for guiding the generation of precise candidate proposals.•The novel dual-scale semantic aggregation module is proposed to retrieve detailed features at different resolutions to contribute with the prediction process.
BibTeX
@article{zhang2023faster,
  author = {Yang Zhang and Le Cheng and Yuting Peng and Chengming Xu and Yanwei Fu and Bo Wu and Guodong Sun},
  title = {{Faster OreFSDet: A lightweight and effective few-shot object detector for ore images}},
  journal = {Pattern Recognition},
  year = {2023},
  url = {https://openreview.net/forum?id=cncFO1hdK8},
}
Figure