Benchmarking the State of AI for Crop Yield Forecasting: A Global Assessment Across Modeling Paradigms

Michiel Kallenberg, Philip Janz, Christoph Jörges, Vageesh Saxena, Pratishtha Poudel, Mohammed Musthafa Rafi, Ioannis N. AthanasiadisarXiv 2026 · arXiv

TL;DR

This paper presents a massive, standardized benchmark of five distinct modeling paradigms—ranging from traditional biophysical simulations to modern tabular foundation models—across 63 country-crop datasets. The authors reveal that while AI significantly outperforms traditional baselines, the real challenge isn't predicting where crops grow well, but when they will fail due to inter-annual anomalies.

What Problem Does This Paper Address?

Predicting crop yields is a high-stakes game for global food security, humanitarian aid, and commodity markets. However, the research field has been fragmented: one study might show a Transformer works well for corn in Illinois, while another shows a biophysical model works for wheat in France.

The authors identify a "generalizability gap." Most existing work focuses on single countries or specific model families, making it impossible to know which approach actually reigns supreme. Furthermore, standard evaluation metrics often conflate spatial skill (knowing that Region A is more productive than Region B) with temporal skill (predicting that this year will be worse than last year). For an early-warning system, the latter is far more important, yet much harder to achieve.

Methods

The researchers implemented a unified experimental framework to compare five "modeling paradigms":

  1. Statistical Baselines: Simple historical averages and linear trend extrapolations.
  2. Process-Based Models: Specifically LPJmL, a biophysical model that simulates plant growth, carbon cycles, and water fluxes based on physical laws.
  3. Feature-Engineered ML: Traditional models like Random Forest and XGBoost using agronomically meaningful summaries (e.g., monthly temperature averages, cumulative growing degree days).
  4. Deep Sequence Models: Neural networks (LSTMs, CNNs, Transformers, and PatchTST) that learn directly from raw daily weather and satellite time-series.
  5. Tabular Foundation Models: Recent "off-the-shelf" models like TabPFN and TabDPT that are pre-trained on massive amounts of diverse tabular data to perform in-context learning.

They utilized a walk-forward evaluation protocol, which mimics real-world deployment by only training on data available before the forecast year.

Datasets

The study uses CY-Bench, a comprehensive global benchmark dataset.

  • Scope: 63 country-crop datasets covering maize (36 countries) and wheat (27 countries).
  • Granularity: Over 12,000 sub-national administrative regions across six continents.
  • Predictors: Weather variables (AgERA5), soil moisture, remote-sensing vegetation indices (NDVI, fPAR), and static soil properties.

Key Insights and Ideas

  • The Spatial vs. Temporal Paradox: Spatial prediction is "easy." Models can easily learn that certain regions are inherently more productive due to soil or climate. However, predicting anomalies (year-to-year fluctuations) remains the "holy grail" and is significantly more difficult for all models.
  • Engineered Features Still Rule: Interestingly, deep sequence models that learn from raw daily data did not consistently beat models using manually engineered agronomic features. In data-constrained regimes (common in agriculture), human domain knowledge (e.g., "calculate the total heat during the flowering month") provides a stronger inductive bias than raw deep learning.
  • The "Physics" Advantage: While the process-based model (LPJmL) had lower overall accuracy, it showed surprisingly strong temporal and anomaly correlation for wheat. This suggests that physical simulations capture the mechanics of weather stress better than pure data-driven models, even if they struggle with absolute yield magnitudes.
  • Foundation Models are Competitive: Tabular foundation models performed on par with or better than highly tuned XGBoost models, suggesting that pre-training on general tabular data transfers well to the agricultural domain.

Key Results

  • Widespread Improvement: Data-driven models reduced the Normalized Root Mean Squared Error (NRMSE) in 72% of maize-growing countries and 78% of wheat-growing countries.
  • Quantifiable Gains: The median reduction in NRMSE compared to the best traditional baseline was 8.8% for maize and 11.9% for wheat.
  • Top Performers: For wheat, tabular foundation models (like TabDPT) achieved the strongest overall performance (NRMSE of 15.9%). For maize, the results were more competitive across ML paradigms, with Transformers and Tabular models performing similarly.
  • Mid-Season Viability: A supplementary analysis showed that models achieve substantial predictive skill halfway through the growing season, proving that AI can provide useful early warnings months before harvest.

Limitations and Future Work

The authors acknowledge several key hurdles:

  • Missing Management Data: The models currently lack data on fertilization, irrigation, cultivar choice, and pest pressure—factors that heavily influence yield but are rarely recorded at a global, sub-national scale.
  • Extreme Events: Current models still struggle to represent the impact of rare, extreme weather events. Future work should focus on "physics-informed" machine learning—hybrid models that combine the raw predictive power of AI with the biophysical constraints of process-based models.
  • Representation Learning: There is a need for models that better align weather time-series with crop phenology (the plant's life stages) rather than just the calendar year.

For more details, the authors have provided an interactive dashboard to explore the results: https://wur-ai.github.io/AgML-CY-Bench-dashboard

Summary updated

Abstract

Accurate crop yield forecasting is essential for food security, agricultural policy, and commodity markets. Although statistical, process-based, and machine learning approaches have all been proposed, their relative strengths remain poorly understood due to the lack of large-scale, standardized comparisons. We address this gap through a comprehensive benchmark of five modeling paradigms -- statistical baselines, process-based models, conventional feature-engineered machine learning, deep sequence models, and tabular foundation models -- using the CY-Bench benchmark spanning 63 country-crop datasets (>12,000 administrative regions) across six continents. Beyond conventional pooled accuracy metrics, we introduce a multi-dimensional evaluation framework that separately quantifies overall, spatial, temporal, and anomaly prediction skill. Across multiple crops and countries, feature-engineered machine learning and tabular foundation models achieve the strongest overall predictive performance. Data-driven models reduce NRMSE in 72% of countries growing maize and 78% of countries growing wheat, with median reductions of 8.8% and 11.9%, respectively. Across all modeling paradigms, spatial prediction is substantially easier than temporal and anomaly prediction. While data-driven models markedly improve temporal and anomaly prediction over statistical baselines, accurately forecasting year-to-year yield variability remains challenging. These findings suggest that future progress in large-scale crop yield forecasting will depend on the improved characterization of the environmental and management factors driving inter-annual yield variability, founded on effective representations for crop yield forecasting systems that support agricultural decision-making, early-warning applications, and food security planning
BibTeX
@misc{kallenberg2026benchmarking,
  author = {Michiel Kallenberg and Philip Janz and Christoph Jörges and Vageesh Saxena and Pratishtha Poudel and Mohammed Musthafa Rafi and Ioannis N. Athanasiadis},
  title = {{Benchmarking the State of AI for Crop Yield Forecasting: A Global Assessment Across Modeling Paradigms}},
  year = {2026},
  eprint = {2611.19330},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.19330},
}
Figure