Mitigating Low Agricultural Productivity of Smallholder Farms in Africa: Time-Series Forecasting for Environmental Stressors

Maryam Tabar, Dongwon Lee, David P. Hughes, Amulya YadavAAAI 2022 · DOI

Introduction

Smallholder farms, typically smaller than two hectares, are critical to food security in Africa. However, these farms face persistent challenges in productivity, largely due to a heavy reliance on rain-fed agriculture. In the context of a changing climate, farmers often lack the necessary data to identify "water stress" in their crops until it is too late for effective intervention. Current data-driven solutions often struggle with two main issues: a focus on estimating current conditions rather than forecasting future stressors, and a lack of generalization across Africa's diverse climatic zones, ranging from semi-arid regions to tropical rainforests.

The CLIMATES Framework

To address these challenges, researchers developed CLIMATES (Clustering Initialized Meta Algorithm for Tackling Environmental Stressors). This meta-algorithm moves away from the search for a single universal model, instead leveraging a heterogeneous ensemble of specialized experts tailored to specific climatic behaviors.

The CLIMATES workflow involves:

  1. Feature-Based Clustering: Using Discrete Fourier Transform (DFT) to extract temporal patterns from farm data, followed by bottom-up agglomerative clustering to group farms with similar environmental dynamics.
  2. Model Selection: Evaluating a diverse set of nine models—including statistical (SARIMA, TBATS), classical machine learning (Random Forest, XGBoost, SVM), and deep learning (LSTM, TCN, SFM)—for each identified cluster.
  3. Meta-Algorithm Execution: At test time, a farm's data is assigned to its nearest cluster, and the best-performing model for that specific cluster is used to generate the forecast.

Data and Methodology

The study utilized a high-resolution dataset of 2,264 smallholder farm locations across 20 African countries, sourced from the FAO’s WaPOR portal (2015–2019). The researchers tracked three key indicators: Actual Evapotranspiration (AET), Reference Evapotranspiration (RET), and Net Primary Production (NPP), with a spatial resolution of ~250m and a temporal resolution of 10 days (dekads).

Results and Discussion

A core finding of the study is that no single model is universally superior across all climatic clusters. As shown in the performance breakdown, different architectures excel depending on the local environmental patterns. For instance, Random Forest might lead in one cluster while SARIMA or LSTM dominates in others.

Table 1: Performance comparison of various models across six distinct clusters, highlighting that different models perform best (bolded) in different climatic zones.

This diversity validates the meta-algorithm approach. When compared against standard deep learning baselines, CLIMATES-I consistently achieved superior accuracy across all three primary indicators (AET, RET, and NPP).

Table 2: Comparative performance of CLIMATES-I against Variational Recurrent Neural Network (VRNN) and LSTM variants.

The researchers also noted that complex generative models like VRNNs often underperformed due to "posterior collapse," where the model ignores latent variables during training. In many cases, well-tuned classical ML models remained highly competitive with deep learning architectures.

Impact and Future Directions

The quantitative improvements offered by CLIMATES translate into significant real-world benefits. For a typical maize farm in Kenya, the increased forecasting accuracy equates to saving approximately 92 liters of water per hectare every day through optimized irrigation scheduling.

Future work focuses on overcoming deployment hurdles, such as limited internet connectivity, by using automated SMS alerts. Additionally, the team plans to explore Federated Learning to address farmer privacy concerns regarding sensitive crop and income data. CLIMATES is currently under evaluation by PlantVillage for deployment as an early warning system in East Africa.

Summary updated

BibTeX
@inproceedings{tabar2022mitigating,
  author = {Maryam Tabar and Dongwon Lee and David P. Hughes and Amulya Yadav},
  title = {{Mitigating Low Agricultural Productivity of Smallholder Farms in Africa: Time-Series Forecasting for Environmental Stressors}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2022},
  doi = {10.1609/aaai.v36i11.21534},
}
Figure