An Enhanced Faster R-CNN for High-Throughput Winter Wheat Spike Monitoring to Improved Yield Prediction and Water Use Efficiency

Donglin Wang, Longfei Shi, Yanbin Li, Binbin Zhang, Guangguang Yang, Serestina ViririAgronomy 2025 · DOI

TL;DR

This paper introduces an enhanced Faster R-CNN model for accurately counting winter wheat spikes using UAV imagery, significantly improving yield prediction and water use efficiency analysis. By integrating ResNet-50 and attention mechanisms, the model achieves state-of-the-art performance, outperforming YOLOv8 and providing crucial data for optimizing water and fertilizer management in precision agriculture.

What Problem Does This Paper Address?

Accurate estimation of winter wheat yield is critical for global food security, but traditional manual counting methods for wheat spikes are time-consuming, labor-intensive, and prone to significant errors (around 15%). Existing automated methods, while improving, often struggle with the high-density planting and severe spike occlusion common in Chinese wheat fields. Furthermore, understanding the complex interplay between water and fertilizer management and their impact on yield and resource efficiency is crucial for sustainable agriculture. This paper aims to bridge this gap by developing a robust, high-throughput system for spike detection, yield prediction, and water-fertilizer management optimization.

Methods

The core of this work is an enhanced Faster R-CNN architecture. The authors replaced the traditional VGG16 backbone with ResNet-50, which offers better feature extraction capabilities and mitigates gradient vanishing issues in deep networks. Crucially, they incorporated channel attention mechanisms to help the model focus on the most salient visual cues of wheat spikes, even in occluded or cluttered environments. This improved model was trained using a comprehensive strategy that fused a large public dataset (Global Wheat Head Detection - GWHD) with newly collected, high-resolution UAV imagery from experimental plots. For yield prediction, a Random Forest (RF) regressor was employed, using the spike counts generated by the Faster R-CNN model as input. This approach was chosen for its ability to capture complex, non-linear relationships.

Datasets

  • Global Wheat Head Detection (GWHD) dataset: A large, publicly available dataset of wheat head images used for initial model training and establishing baseline generalization capabilities.
  • Localized Experimental Data: High-resolution multispectral imagery (4096 × 3072 pixels) captured by a DJI Mavic 3M UAV over two growing seasons (2022-2023 and 2023-2024) from experimental plots with varied irrigation and fertilization treatments. This dataset was specifically curated to address the limitations of the GWHD dataset in representing high-density planting and complex field conditions. Approximately 2000 images were systematically annotated using LabelMe.

Key Insights and Ideas

  • Attention is Key for Occlusion: The integration of attention mechanisms proved vital for improving spike detection accuracy, particularly in challenging scenarios with significant spike occlusion. This suggests that focusing on salient features is more effective than relying on complete spike visibility.
  • ResNet-50 Offers a Better Backbone: Replacing VGG16 with ResNet-50 not only reduced computational complexity but also improved feature representation and training stability, leading to better overall performance.
  • Spike Count as a Robust Yield Proxy: The study strongly validates that spike density, accurately captured by the enhanced Faster R-CNN, is a reliable predictor of wheat yield, outperforming traditional vegetation indices in certain contexts.
  • Synergistic Water-Fertilizer Management is Crucial: The research highlights that optimal yield and resource efficiency are not achieved by simply increasing water or fertilizer inputs. Instead, a balanced approach, particularly combining organic and inorganic fertilizers under deficit irrigation, can significantly enhance water use efficiency and yield benefits.

Key Results

  • Spike Detection Accuracy: The enhanced Faster R-CNN achieved a mean average precision ([email protected]) of 91.2% and a recall of 88.72%.
  • Outperforming YOLOv8: The proposed model demonstrated a statistically significant 2.1% higher mAP compared to YOLOv8.
  • Yield Prediction Performance: The Random Forest model, using spike counts as input, achieved a superior R² of 0.82 and an RMSE of 324.42 kg·ha⁻¹, significantly outperforming other machine learning models.
  • Water Use Efficiency: Under deficit irrigation, the 3:7 organic/inorganic fertilizer treatment achieved optimal water productivity (WP) of 11.65 kg·m⁻³ and water use efficiency (WUE) of 20.16 kg·ha⁻¹·mm⁻¹.
  • Maximum Yield Benefit: Organic fertilizer under full irrigation yielded the highest monetary benefit (CNY 13,679.26 ha⁻¹), but with lower water productivity.

Limitations and Future Work

  • Sensitivity to Phenological Stages: The model shows reduced performance during the maturity stage due to lower color contrast in RGB images, suggesting a need for more robust spectral information.
  • Generalizability: While robust in high-density fields similar to the training data, the model's generalizability to different wheat genotypes, extreme climates, or unconventional planting patterns needs further validation.
  • Temporal Information: The current framework does not fully exploit temporal information from time-series UAV imagery, which could enhance dynamic yield forecasting.

Future work will focus on:

  • Integrating hyperspectral or thermal data to improve spectral robustness.
  • Expanding the dataset to include multi-regional and multi-seasonal data.
  • Exploring attention-based transformer architectures or temporal convolutional networks (TCNs).
  • Standardizing UAV flight protocols for improved dataset quality.
  • Incorporating seasonal climate forecasts for more accurate predictions.

Summary updated

Abstract

This study develops an innovative unmanned aerial vehicle (UAV)-based intelligent system for winter wheat yield prediction, addressing the inefficiencies of traditional manual counting methods (with approximately 15% error rate) and enabling quantitative analysis of water–fertilizer interactions. By integrating an enhanced Faster Region-Based Convolutional Neural Network (Faster R-CNN) architecture with multi-source data fusion and machine learning, the system significantly improves both spike detection accuracy and yield forecasting performance. Field experiments during the 2022–2023 growing season captured high-resolution multispectral imagery for varied irrigation regimes and fertilization treatments. The optimized detection model incorporates ResNet-50 as the backbone feature extraction network, with residual connections and channel attention mechanisms, achieving a mean average precision (mAP) of 91.2% (calculated at IoU threshold 0.5) and 88.72% recall while reducing computational complexity. The model outperformed YOLOv8 by a statistically significant 2.1% margin (p < 0.05). Using model-generated spike counts as input, the random forest (RF) model regressor demonstrated superior yield prediction performance (R2 = 0.82, RMSE = 324.42 kg·ha−1), exceeding the Partial Least Squares Regression (PLSR) (R2 +46%, RMSE-44.3%), Least Squares Support Vector Machine (LSSVM) (R2 + 32.3%, RMSE-32.4%), Support Vector Regression (SVR) (R2 + 30.2%, RMSE-29.6%), and Backpropagation (BP) Neural Network (R2+22.4%, RMSE-24.4%) models. Analysis of different water–fertilizer treatments revealed that while organic fertilizer under full irrigation (750 m3 ha−1) conditions achieved maximum yield benefit (13,679.26 CNY·ha−1), it showed relatively low water productivity (WP = 7.43 kg·m−3). Conversely, under deficit irrigation (450 m3 ha−1) conditions, the 3:7 organic/inorganic fertilizer treatment achieved optimal WP (11.65 kg m−3) and WUE (20.16 kg∙ha−1∙mm−1) while increasing yield benefit by 25.46% compared to organic fertilizer alone. This research establishes an integrated technical framework for high-throughput spike monitoring and yield estimation, providing actionable insights for synergistic water–fertilizer management strategies in sustainable precision agriculture.
BibTeX
@inproceedings{wang2025enhanced,
  author = {Donglin Wang and Longfei Shi and Yanbin Li and Binbin Zhang and Guangguang Yang and Serestina Viriri},
  title = {{An Enhanced Faster R-CNN for High-Throughput Winter Wheat Spike Monitoring to Improved Yield Prediction and Water Use Efficiency}},
  booktitle = {Agronomy},
  year = {2025},
  doi = {10.3390/agronomy15102388},
}
Figure