Class-attention-based lesion proposal convolutional neural network for strawberry diseases identification

Xiaobo Sharon Hu, Rujing Wang, Jianming Du, Yimin Hu, Lin Jiao, Taosheng XuFrontiers in Plant Science 2023 · DOI

Abstract

Accurate field identification of strawberry diseases is hindered by complex backgrounds and subtle inter-class differences. We propose the Class-Attention-based Lesion Proposal Convolutional Neural Network (CALP-CNN), which uses a cascade architecture to locate main lesion objects and propose discriminative details. Achieving a 91.96% F1-score on a self-built dataset, CALP-CNN outperforms state-of-the-art methods by focusing on fine-grained features while filtering environmental noise.

Introduction

Identifying strawberry diseases in real-world field conditions is significantly more challenging than in controlled laboratory settings. Standard computer vision models often struggle with two primary issues: complex background interference (soil, mulch, weeds) and subtle differences between disease classes that may only be distinguishable by minute textures within a small lesion. Existing methods often require labor-intensive bounding box annotations to train effectively; however, the CALP-CNN achieves high-precision recognition using only image-level labels.

The CALP-CNN Architecture

The core innovation is the Class-Attention-based Lesion Proposal Convolutional Neural Network (CALP-CNN). This model employs a three-scale cascade architecture to refine its focus:

  1. Scale 1 (Raw Image): Provides a coarse-grained view of the entire scene.
  2. Scale 2 (Main Lesion Object): The Class Object Location Module (COLM) generates a Class Response Map (CRM) to identify the most relevant pixels for a specific disease, cropping the image to focus on the primary lesion and discarding background noise.
  3. Scale 3 (Lesion Details): The Lesion Part Proposal Module (LPPM) identifies the five most informative sub-patches within the cropped lesion to capture fine-grained textures.
Figure 6: Field images of strawberry plants exhibiting severe disease symptoms like wilting and necrosis, illustrating the complex backgrounds the model must navigate.

A critical component is the inter-scale pairwise ranking loss, which mathematically forces the model to have higher confidence in its zoomed-in predictions than in its raw image predictions, ensuring the "zoom" branches learn truly discriminative features.

Dataset: The Strawberry Common Disease Dataset (SCDD)

To train and evaluate the model, researchers introduced the Strawberry Common Disease Dataset (SCDD), containing 3,411 high-quality images across 11 disease classes (such as leaf scorch, gray mold, and anthracnose) and a healthy category. These images were collected from fields in ChangFeng County, China, and supplemented with web-scraped data to ensure diversity in angles, focal lengths, and lighting conditions.

Figure 4: Examples of strawberry leaf diseases from the SCDD dataset, showing characteristic lesions used for fine-grained classification.

Key Results and Discussion

CALP-CNN achieved an overall accuracy of 92.56% and an F1-score of 91.96%. It significantly outperformed the sub-optimal baseline, MMAL-Net, by 6.52% in F1-score and showed a 9.49% improvement over a standard ResNet-50 backbone. Ablation studies confirmed that the background-filtering "Object" branch (Scale 2) was the most vital component, as removing it led to the largest performance drop.

The model proved particularly effective at distinguishing between diseases that appear nearly identical in early stages, outperforming standard backbones by nearly 6% in these difficult scenarios. This success is attributed to the class-aware attention mechanism, which was found to be 5.57% more accurate than standard class-agnostic saliency methods.

Conclusion

CALP-CNN provides a robust solution for field-based strawberry disease identification. By utilizing class-aware attention to "smart zoom" into discriminative lesion details, the model effectively overcomes the noise of agricultural environments. Future work will focus on improving performance for very small lesions and reducing the computational complexity of the multi-branch architecture.

Summary updated

Abstract

Diseases have a great impact on the quality and yield of strawberries, an accurate and timely field disease identification method is urgently needed. However, identifying diseases of strawberries in field is challenging due to the complex background interference and subtle inter-class differences. A feasible method to address the challenges is to segment strawberry lesions from the background and learn fine-grained features of the lesions. Following this idea, we present a novel Class-Attention-based Lesion Proposal Convolutional Neural Network (CALP-CNN), which utilizes a class response map to locate the main lesion object and propose discriminative lesion details. Specifically, the CALP-CNN firstly locates the main lesion object from the complex background through a class object location module (COLM) and then applies a lesion part proposal module (LPPM) to propose the discriminative lesion details. With a cascade architecture, the CALP-CNN can simultaneously address the interference from the complex background and the misclassification of similar diseases. A series of experiments on a self-built dataset of field strawberry diseases is conducted to testify the effectiveness of the proposed CALP-CNN. The classification results of the CALP-CNN are 92.56%, 92.55%, 91.80% and 91.96% on the metrics of accuracy, precision, recall and F1-score, respectively. Compared with six state-of-the-art attention-based fine-grained image recognition methods, the CALP-CNN achieves 6.52% higher (on F1-score) than the sub-optimal baseline MMAL-Net, suggesting that the proposed methods are effective in identifying strawberry diseases in the field.
BibTeX
@inproceedings{hu2023class,
  author = {Xiaobo Sharon Hu and Rujing Wang and Jianming Du and Yimin Hu and Lin Jiao and Taosheng Xu},
  title = {{Class-attention-based lesion proposal convolutional neural network for strawberry diseases identification}},
  booktitle = {Frontiers in Plant Science},
  year = {2023},
  doi = {10.3389/fpls.2023.1091600},
}
Figure