Automatic Crop Pest Detection Oriented Multiscale Feature Fusion Approach

Shifeng Dong, Jianming Du, Lin Jiao, Fenmei Wang, Kang Liu, Yue Teng, Rujing WangInsects 2022 · DOI

TL;DR

This paper introduces MCPD-net, a novel deep learning approach for automatically detecting and classifying multiple types of crop pests. By employing a multiscale feature pyramid network (MFPN) for enhanced feature fusion and an adaptive feature region proposal network (AFRPN) to address small object detection challenges, the method achieves state-of-the-art performance on a new, large-scale pest dataset.

What Problem Does This Paper Address?

Accurate and timely pest monitoring is crucial for agricultural productivity, but traditional methods rely on manual inspection, which is labor-intensive, time-consuming, and prone to human error. While deep learning has shown promise in automating this task, existing methods struggle with two key challenges: (1) detecting small pests, where crucial information can be lost during network training, and (2) distinguishing between pest species that have very similar physical appearances. These limitations hinder the development of effective, automated pest management systems.

Methods

The core of this work is the proposed MCPD-net, a multi-category pest detection network built upon a two-stage object detection framework. It comprises several key components:

  • Multiscale Feature Pyramid Network (MFPN): This module is designed to effectively fuse features from different scales. It incorporates an Adaptive Channel Fusion (ACFM) module that leverages adaptive global average pooling and adaptive max-pooling to capture relationships across channels, and a Global Context (GC) module to integrate broader contextual information. This aims to improve the detection of pests with varying sizes and enhance feature representation.
  • Adaptive Feature Region Proposal Network (AFRPN): This novel component addresses issues in traditional Region Proposal Networks (RPNs), particularly the misalignment between anchors and features, which is problematic for small objects. AFRPN introduces a Feature Adaptation Module (FAM) that uses deformable convolutions to learn offsets, allowing for better spatial sampling and alignment. It also employs a two-stage RPN process to refine anchor predictions.

Datasets

The authors introduce a new benchmark dataset:

  • Multi-Category Pests Dataset 2021 (MPD2021): This dataset was specifically created to address the limitations of existing datasets, which are often focused on recognition rather than multi-category detection in a single image. MPD2021 contains 18,595 images with 125,700 annotated pest instances across 26 categories. The dataset is noted for its large number of small objects and the high similarity between some pest species, making it a challenging benchmark. The dataset was split into training and testing sets with a 4:1 ratio.

Key Insights and Ideas

  • The importance of multiscale feature fusion for pest detection: The paper strongly emphasizes that simply using standard feature pyramids isn't enough. The proposed MFPN, with its adaptive channel fusion and global context integration, is crucial for capturing the diverse scales and subtle features of pests, especially small ones.
  • Addressing anchor-feature misalignment is critical for small objects: The AFRPN's innovation in using deformable convolutions to learn offsets is a key insight. This directly tackles the problem where small objects might not have sufficient overlap with anchors in traditional RPNs, leading to them being missed.
  • A new benchmark dataset is essential for progress: The creation of MPD2021, with its specific challenges (small objects, similar species), highlights the need for tailored datasets to drive advancements in this domain.

Key Results

The proposed MCPD-net achieved impressive results on the MPD2021 dataset:

  • Overall Performance: The model achieved a mean Average Precision (mAP) of 67.3% and an Average Recall (AR) of 89.3%.
  • Comparison to State-of-the-Art: MCPD-net outperformed other deep learning-based object detection methods like SSD, FCOS, PAFPN, and Mask R-CNN in terms of mAP and AR.
  • Specific Improvements:
    • The MFPN module alone improved detection AP for tiny pests (categories 1 and 12) by approximately 12.3% and 7.6%, respectively.
  • The AFRPN module significantly enhanced AR50 to 87.8% compared to the baseline.
  • The combined MFPN and AFRPN achieved the best overall performance.
  • Qualitative Results: Visualizations demonstrated MCPD-net's ability to accurately detect tiny pests, handle complex backgrounds, and differentiate between densely distributed pests.

Limitations and Future Work

  • Tiny Pest Detection: Despite significant improvements, the detection accuracy for some very small pests (e.g., Nilaparvata lugens, Plutella xylostella) remains lower than for other categories. These pests occupy a very small percentage of the image pixels.
  • Future Work: The authors plan to further extend the number of pest categories in the dataset and focus on improving the detection accuracy for tiny pests. They also aim to enhance the precision of chemical pesticide application by providing more accurate pest identification.

Summary updated

Abstract

Specialized pest control for agriculture is a high-priority agricultural issue. There are multiple categories of tiny pests, which pose significant challenges to monitoring. Previous work mainly relied on manual monitoring of pests, which was labor-intensive and time-consuming. Recently, deep-learning-based pest detection methods have achieved remarkable improvements and can be used for automatic pest monitoring. However, there are two main obstacles in the task of pest detection. (1) Small pests often go undetected because much information is lost during the network training process. (2) The highly similar physical appearances of some categories of pests make it difficult to distinguish the specific categories for networks. To alleviate the above problems, we proposed the multi-category pest detection network (MCPD-net), which includes a multiscale feature pyramid network (MFPN) and a novel adaptive feature region proposal network (AFRPN). MFPN can fuse the pest information in multiscale features, which significantly improves detection accuracy. AFRPN solves the problem of anchor and feature misalignment during RPN iterating, especially for small pest objects. In extensive experiments on the multi-category pests dataset 2021 (MPD2021), the proposed method achieved 67.3% mean average precision (mAP) and 89.3% average recall (AR), outperforming other deep learning-based models.
BibTeX
@inproceedings{dong2022automatic,
  author = {Shifeng Dong and Jianming Du and Lin Jiao and Fenmei Wang and Kang Liu and Yue Teng and Rujing Wang},
  title = {{Automatic Crop Pest Detection Oriented Multiscale Feature Fusion Approach}},
  booktitle = {Insects},
  year = {2022},
  doi = {10.3390/insects13060554},
}
Figure