YOLOX target detection model can identify and classify several types of tea buds with similar characteristics

M.c.k. Yang, Weihao Yuan, Gaojian XuScientific 2024 · DOI

This paper, published in Scientific Reports, presents a deep learning approach to a delicate agricultural challenge: automating the identification and classification of tea buds. By evaluating several state-of-the-art object detection models, the researchers demonstrate that the YOLOX architecture can effectively distinguish between tea varieties that appear nearly identical, providing a technical foundation for the next generation of intelligent tea-harvesting robots.

TL;DR

Researchers developed a high-precision recognition system using the YOLOX model to detect and classify four visually similar tea varieties. YOLOX outperformed six other mainstream models (including YOLOv7 and Faster R-CNN), achieving a 95.47% mAP, proving that anchor-free detection is highly effective for the subtle features of tea shoots.

What Problem Does This Paper Address?

The quality of tea is fundamentally tied to the "plucking" stage—specifically, identifying and harvesting tender buds while leaving older leaves behind. While manual plucking ensures high quality, it is slow, expensive, and faces labor shortages.

Existing mechanical harvesters are "dumb"; they lack the visual intelligence to distinguish between different tea varieties or to precisely locate the bud and stalk. This is a difficult computer vision problem because tea buds are small, and different varieties—such as Longjing 43 and NongKang Early—have extremely similar color profiles and shapes. The gap addressed here is the need for a model that is both fast enough for real-time machinery and precise enough to handle "fine-grained" classification of similar agricultural products.

Methods

The researchers conducted a head-to-head comparison of seven mainstream object detection algorithms: YOLOv4, YOLOv5, YOLOX, YOLOv7, EfficientDet, Faster R-CNN, and CenterNet.

The standout performer was YOLOX. Unlike earlier YOLO versions that rely on "anchors" (pre-defined bounding boxes), YOLOX is anchor-free. This reduces the complexity of the model and the number of parameters, leading to faster detection and better generalization. They also utilized:

  • Decoupled Heads: Separating the classification and localization tasks to improve convergence speed.
  • SimOTA: An advanced label assignment strategy that helps the model decide which "pixels" belong to which object more accurately.
  • K-means Clustering: Used to optimize the initial positions of the detection frames before training began.

To compare the models fairly, the authors used a "comprehensive index" formula that weighted mAP (mean Average Precision) and F1 scores more heavily than raw precision or recall, ensuring the chosen model was the most balanced for real-world use.

Datasets

The authors introduced the TBD (Tea Bud Dataset):

  • Size: 3,728 images.
  • Varieties: Four distinct categories with similar characteristics: Anji White Tea, Huangshan Seed, Longjing 43, and NongKang Early.
  • Capture Conditions: To ensure the model wasn't "cheating" by learning specific lighting, images were taken in both sunny and cloudy conditions.
  • Multi-angle approach: Images were captured from three specific angles (90° vertical, 45° left, and 45° right) to simulate the perspective of a robot moving over a tea bush.

Key Insights and Ideas

  • The "Anchorless" Advantage: The transition from anchored models (like YOLOv4) to anchorless ones (YOLOX) was the primary driver of success. It allowed the model to be more flexible in identifying the irregular, organic shapes of tea buds.
  • Color Contrast is King: The model performed best on the "Huangshan Seed" variety (90.54% precision). The authors noted this was because this variety has the most prominent color difference between the tender shoots and the background of old leaves.
  • The Similarity Trap: The model occasionally confused NongKang Early with Longjing 43. This "aha moment" highlights that for certain varieties, color alone isn't enough; future models may need to lean more heavily on texture or geometric features.
  • Classification Matters: Most previous research focused only on detecting buds. This paper argues that classifying the variety is essential for industrial-scale processing where different varieties might be harvested in the same region but require different processing temperatures or times.

Key Results

  • Top Performer: YOLOX achieved the best overall metrics with a Precision of 89.34%, Recall of 93.56%, and an mAP of 95.47%.
  • Variety-Specific Precision:
    • Huangshan Seed: 90.54%
    • Longjing 43: 80%
    • NongKang Early: 77.78%
    • Anji White Tea: 76.19%
  • Efficiency: YOLOX showed rapid convergence, stabilizing after only about 50 training iterations, making it a computationally efficient choice for developers.

Limitations and Future Work

  • Visual Ambiguity: The precision for Anji White Tea and NongKang Early remains lower (76-77%) due to their extreme visual similarity to other varieties. The authors suggest that the model needs more "robustness" to handle these edge cases.
  • Environmental Variables: While they tested different lighting, they did not extensively test the model against heavy dew, dust, or moving branches, which are common in actual field harvesting.
  • Next Steps: The researchers plan to extend the study to improve model robustness and eventually integrate the software into a physical mechanical picking system to test real-time performance in the field.

Summary updated

Abstract

Currently, the accuracy of tea bud identification is crucial in the intelligent development of the tea industry, and this is due to the fact that identifying tea buds is a key step in determining the quality of tea and distinguishing the categories. In this experiment, 3728 tea shoots with similar characteristics in four categories (Anji White Tea, Huangshan Seed, Longjing 43, and NongKang Early) were photographed to establish the dataset TBD (Tea Bud Dataset). In this experiment, we constructed a tea shoot recognition model. We used seven mainstream algorithms (YOLOv4, YOLOv5, YOLOX, YOLOv7, EfficientDet, Faster R-CNN and CenterNet) to conduct shoot recognition comparison experiments and found that the YOLOX algorithm performs the best with its Precision, Recall, F1 score, mAP 89.34%, 93.56%, 0.91, and 95.47%, respectively. Then the YOLOX algorithm combined with the dataset to construct the shoot recognition model, the shoots of four kinds of tea to establish a tea shoot classification model, the model to identify the Anji white tea shoots of Precision 76.19%, the yellow mountain species of Precision 90.54%, Longjing 43 Precision 80%, NongKang early to the morning of the Precision was 77.78%. The results of this experiment show that the established tea shoot classification model has achieved a better classification of the above four types of tea shoots, which can also understand the feasibility of mechanical intelligent tea picking and provide some theoretical support for the application of mechanical intelligent tea picking in practice.
BibTeX
@inproceedings{yang2024yolox,
  author = {M.C.K. Yang and Weihao Yuan and Gaojian Xu},
  title = {{YOLOX target detection model can identify and classify several types of tea buds with similar characteristics}},
  booktitle = {Scientific},
  year = {2024},
  doi = {10.1038/s41598-024-53498-y},
}
Figure