YOLOv12-BDA: A Dynamic Multi-Scale Architecture for Small Weed Detection in Sesame Fields

Guofeng Xia, Xin LiSensors 2025 · DOI

TL;DR

This paper introduces YOLOv12-BDA, a novel deep learning architecture designed for highly accurate, real-time detection of small weeds in dense sesame fields. By incorporating a dual-backbone, dynamic feature fusion, and adaptive scale-aware mechanisms, it significantly boosts detection performance, especially for challenging small targets, while maintaining practical inference speeds for agricultural applications.

What Problem Does This Paper Address?

Sesame is a vital global crop, but weed infestation severely impacts its yield and quality. Detecting and controlling these weeds, especially small ones in their early growth stages, is crucial. However, this is challenging in sesame fields due to:

  • Morphological Similarity: Young sesame plants and common weeds look very alike, making them hard to distinguish.
  • Dense Planting: Narrow row spacing leads to overlapping foliage, obscuring weeds.
  • Narrow Intervention Window: Effective weed control requires early detection, when visual differences are minimal. Existing object detection models often struggle with these specific challenges, particularly with small, occluded targets in complex agricultural backgrounds.

Methods

The authors propose YOLOv12-BDA, an enhanced version of the YOLOv12 architecture, featuring three key innovations:

  1. Adaptive Feature Selection (AFS) Dual-Backbone with Dynamic Learning Unit (DLU): Instead of a single backbone, YOLOv12-BDA uses two parallel backbones (one for spatial details, one for semantic features). The DLU module adaptively fuses features from these backbones using dynamically generated weights, improving feature representation for both small weed localization and crop-weed discrimination.
  2. Dynamic Grouped Convolution and Channel Mixing Transformer (DGCS) Module: This module replaces the standard C3K2 component in the backbone. It uses an asymmetric 1:3 channel split and grouped convolutions to efficiently extract discriminative features, crucial for distinguishing subtle differences between similar-looking crop and weed seedlings.
  3. Dynamic Adaptive Scale-aware Interactive (DASI) Module: Integrated into the neck network, this module enhances multi-scale feature fusion. It dynamically adjusts fusion weights based on input feature activations, allowing the network to prioritize features relevant to different target scales (e.g., fine details for small weeds, semantic context for larger ones). This addresses the limitations of traditional static feature fusion methods.

Datasets

  • Sesame Field Dataset: A high-resolution dataset of 1300 images specifically for sesame weed detection, used for training, validation, and testing.
  • WeedCrop Image Dataset: A publicly available dataset with 2822 images covering multiple crop and weed species, used for cross-domain transfer evaluation to assess the model's generalization capabilities.

Key Insights and Ideas

  • Dual-Backbone for Complementary Features: The idea of using parallel backbones to capture both fine-grained spatial details and high-level semantic information simultaneously is effective for complex agricultural scenes.
  • Dynamic Fusion is Key: The success of DASI highlights that adaptive, content-aware feature fusion is superior to static methods for handling the extreme scale variations found in agricultural imagery.
  • Efficiency Through Asymmetry: The DGCS module's asymmetric channel processing demonstrates that significant feature extraction gains can be achieved without processing all channels equally, leading to computational efficiency.
  • DASI as the Primary Driver: Ablation studies show that the DASI module provides the most substantial individual performance boost, particularly for the challenging mAP@50:95 metric, underscoring its importance for precise localization.

Key Results

  • YOLOv12-BDA achieved state-of-the-art performance on the sesame weed detection dataset, with mAP@50 of 91.57% and mAP@50:95 of 67.46%.
  • This represents significant improvements over the baseline YOLOv12n: +4.67% in mAP@50 and +16.09% in mAP@50:95.
  • The model maintains real-time capability with an inference speed of 113 FPS, despite increased computational requirements (4.51 M parameters, 10.7 GFLOPs).
  • On the cross-domain WeedCrop dataset, YOLOv12-BDA also showed improved performance over baselines, demonstrating architectural robustness.

Limitations and Future Work

  • Computational Cost: While real-time, the model has increased parameters and GFLOPs compared to baselines, which might limit deployment on highly resource-constrained devices. Future work includes model compression and quantization.
  • Cross-Domain Transfer: While robust, the model still shows performance degradation on a different dataset, indicating the need for domain-specific adaptation for broader generalization.
  • Species-Level Identification: The current work focuses on binary crop-weed classification. Future research will aim to identify individual weed species for more precise herbicide application.
  • Extreme Conditions: The model's performance under severe occlusion, extremely dense weed coverage, or adverse weather conditions needs further systematic quantification.
  • Dataset Diversity: Expanding datasets to include more crop types, geographical regions, and environmental conditions is planned.

Summary updated

Abstract

Sesame (<i>Sesamum indicum</i> L.) is one of the most important oilseed crops globally, valued for its high content of unsaturated fatty acids, proteins, and essential nutrients. However, weed infestation represents a major constraint on sesame productivity, competing for resources and releasing allelopathic compounds that can significantly reduce both yield and quality without timely control. To address the challenge of low detection accuracy in complex agricultural environments with dense weed distributions, this study proposes YOLOv12-BDA, a dynamic multi-scale architecture for small weed detection in sesame fields. The proposed architecture incorporates three key dynamic innovations: (1) an Adaptive Feature Selection (AFS) dual-backbone network with a Dynamic Learning Unit (DLU) module that enhances cross-branch feature extraction while reducing computational redundancy; (2) a Dynamic Grouped Convolution and Channel Mixing Transformer (DGCS) module that replaces the C3K2 component to enhance real-time detection of small weeds against complex farmland backgrounds; and (3) a Dynamic Adaptive Scale-aware Interactive (DASI) module integrated into the neck network to strengthen multi-scale feature fusion and detection accuracy. Experimental validation on high-resolution sesame field datasets demonstrates that YOLOv12-BDA significantly outperforms baseline models. The proposed method achieves mAP@50 improvements of 6.43%, 11.72%, 7.15%, 5.33%, and 4.67% over YOLOv5n, YOLOv8n, YOLOv10n, YOLOv11n, and YOLOv12n, respectively. The results confirm that the proposed dynamic architecture effectively improves small-target weed detection accuracy at the cost of increased computational requirements (4.51 M parameters, 10.7 GFLOPs). Despite these increases, the model maintains real-time capability (113 FPS), demonstrating its suitability for precision agriculture applications prioritizing detection quality. Future work will focus on expanding dataset diversity to include multiple crop types and optimizing the architecture for broader agricultural applications.
BibTeX
@inproceedings{xia2025yolov,
  author = {Guofeng Xia and Xin Li},
  title = {{YOLOv12-BDA: A Dynamic Multi-Scale Architecture for Small Weed Detection in Sesame Fields}},
  booktitle = {Sensors},
  year = {2025},
  doi = {10.3390/s25226927},
}
Figure