SAF-YOLO: Super-Resolution Augmented Detection Model with Visual State Space Enhancement for Safflower Filament Picking

Mengyu Duan, Xiaorong Wang, Linwei Qiu, Menghao Li, Jinrong Chen, Liang HeResearch Square 2025 · DOI

TL;DR

SAF-YOLO is a specialized object detection model designed to help robots harvest safflower filaments in complex, cluttered field environments. By combining Mamba-inspired Visual State Space Models (VSSM) with a clever "training-only" super-resolution branch, the researchers achieved a 93.3% mAP, significantly outperforming standard YOLOv8 and YOLOv11 models without increasing the computational cost during actual robotic operation.

What Problem Does This Paper Address?

Safflower is a high-value crop used in traditional medicine, but harvesting it is a back-breaking, manual process. While agricultural robots are the obvious solution, the "vision" part is incredibly difficult. Safflower filaments are tiny, they grow in dense clusters, and they are often obscured by leaves and branches.

Existing object detection models (like the popular YOLO series) often struggle in these "unstructured" environments. They frequently miss small targets or produce false positives because the background is too noisy and the lighting is unpredictable. Furthermore, the filaments look different at various growth stages (Bud, Prime, and Septum), leading to a data imbalance that makes it hard for a general-purpose model to learn effectively.

Methods

The authors introduce SAF-YOLO, which builds upon the YOLO architecture with three primary innovations:

  1. VSS-SPPF (Visual State Space Enhancement): The researchers integrated a Visual State Space Model (VSSM)—specifically the 2D-Selective-Scan (SS2D) strategy from the "Mamba" architecture—into the backbone of the network. Unlike standard Convolutional Neural Networks (CNNs) that have a fixed, local "view," VSSM allows the model to capture global spatial context by scanning the image in four directions. This helps the model distinguish thin filaments from the surrounding green clutter.
  2. AFPN (Asymptotic Feature Pyramid Network): In the "neck" of the model (where features of different sizes are fused), they replaced standard structures with an AFPN. This progressively integrates low-level and high-level features using adaptive weights, which reduces "conflicting information" and makes the model much more sensitive to targets of varying scales.
  3. SRSS (Super-Resolution Self-Supervised Branch): This is perhaps the most ingenious part. During training, the model includes an auxiliary branch that tries to reconstruct high-resolution images from the internal features. This forces the backbone to learn "fine-grained" details necessary for seeing tiny filaments. Crucially, this branch is discarded during inference. This means the model gets the benefit of "sharper" feature learning during training without any extra "computational tax" when the robot is running in the field.

Datasets

The study used a custom safflower filament dataset collected in Jimsar County, Xinjiang, China.

  • Size: 2,000 images captured with a CCD camera (1920x1080 resolution).
  • Diversity: Images were taken under various lighting conditions (front light, back light, glare, dim, and night) and different camera angles (30° to 90°).
  • Growth Stages: The data covers three distinct stages: the Bud stage (smallest targets), the Prime stage (most abundant), and the Septum stage (most challenging due to sparse distribution).

Key Insights and Ideas

  • The "Mamba" Advantage: The paper demonstrates that the linear complexity and global receptive field of State Space Models are a perfect fit for agricultural tasks where the "target" (a filament) is tiny compared to the "context" (the whole plant).
  • Training vs. Inference Asymmetry: By using the SRSS branch, the authors prove you can "super-charge" a model's feature extraction capabilities without making the final deployment model any heavier or slower.
  • Small Object Priority: The results show that the biggest gains were in the "Bud" stage. Standard models often fail here because the features are too weak; SAF-YOLO’s super-resolution guidance specifically addresses this "feature vanishing" problem.

Key Results

SAF-YOLO achieved impressive metrics across the board:

  • Accuracy: 90.1% Precision, 85.9% Recall, and 93.3% mAP.
  • Comparison to Baselines: It outperformed YOLOv11n (the latest standard) by 4.1% mAP and YOLOv8n by 6.9% mAP.
  • Small Object Detection: In the specific "mAP_S" (small objects) category, SAF-YOLO reached 41.2%, significantly higher than traditional small-object detectors like Faster R-CNN (24.3%) or SSD (5.4%).
  • Efficiency: Despite the added complexity during training, the final model size is only 6.4 MB, making it highly suitable for edge devices like the NVIDIA Jetson series used on mobile robots.

Limitations and Future Work

While the paper shows a massive leap in detection, a few areas remain for exploration:

  • Septum Stage Performance: Although SAF-YOLO improved detection in the "Septum" stage to 90.1% AP, this is still lower than the 96.4% achieved in the Prime stage, suggesting that extremely sparse/imbalanced data remains a hurdle.
  • Real-world Robotic Integration: The paper focuses on the detection model. The next logical step, which the authors hint at, is integrating this into a full "end-to-end" harvesting system that includes path planning and mechanical picking arm control.
  • Temporal Data: The current model processes static frames. Future versions could potentially use video sequences to maintain "tracking" of filaments as the robot moves through the field.

Summary updated

Abstract

<title>Abstract</title> Cluttered backgrounds, variable shooting angles, and fluctuating lighting in safflower fields frequently induce missed or false detections of filaments by picking robots, especially for small and imbalanced targets. To address these inherent limitations, we propose SAF-YOLO, a novel detector tailored for safflower filament detection. It incorporates three complementary innovations: (1) A causal Visual State Space Model (VSSM)-based VSS-SPPF module integrated into the Backbone, enhancing spatial context modeling to separate filaments from noisy backgrounds; (2) An Asymptotic Feature Pyramid Network (AFPN) structure in the Neck, optimizing feature adaptive aggregation to boost multi-scale targets sensitivity; (3) An auxiliary Super-Resolution Self-Supervised (SRSS) branch, addressing small and imbalanced target distribution by enabling fine-grained feature learning via high-resolution reconstruction during training, while being discarded at inference to avoid computational overhead. Experimental results demonstrate SAF-YOLO achieves 90.1% Precision, 85.9% Recall, and 93.3% mAP. This outperforms the popular YOLO variants, including YOLOv5/v7/v8/v11 (mAP +4.1%-8.0%), and mainstream small-object detectors (e.g., SSD, Faster R-CNN, CFINet, CFPT, and InSPyReNet; mAP +7.9%-26.2%). Our SAF-YOLO can effectively solve safflower filament detection challenges in complex fields, supporting robotic precision picking.
BibTeX
@inproceedings{duan2025saf,
  author = {Mengyu Duan and Xiaorong Wang and Linwei Qiu and Menghao Li and Jinrong Chen and Liang He},
  title = {{SAF-YOLO: Super-Resolution Augmented Detection Model with Visual State Space Enhancement for Safflower Filament Picking}},
  booktitle = {Research Square},
  year = {2025},
  doi = {10.21203/rs.3.rs-8208511/v1},
}
Figure