Monitoring canopy SPAD based on UAV and multispectral imaging over fruit tree growth stages and species

Yirui Huang, Dongming Li, Xuan Liu, Zhenhui RenFrontiers in Plant Science 2024 · DOI

TL;DR

Researchers have developed a robust method for monitoring fruit tree health by combining UAV-based multispectral imaging with machine learning. By fusing spectral reflection data with canopy texture features and using Gaussian Process Regression (GPR), the team created a "universal" model that accurately estimates chlorophyll levels ($R^2 \approx 0.7$) across different species and growth stages.

What Problem Does This Paper Address?

Chlorophyll content is a vital indicator of a tree's photosynthetic capacity and overall nutrient status. Traditionally, measuring this requires either destructive chemical analysis or labor-intensive hand-held sensors (like SPAD meters). While remote sensing via satellites or drones offers a faster alternative, most existing models are "brittle"—they work well for one specific species at one specific time of year but fail when applied to different trees or different phenological stages.

The challenge lies in canopy heterogeneity. Factors like leaf shape, tree density, and fruit load change the way light reflects off the canopy, often "saturating" standard spectral indices. This paper seeks a transferable, multivariate approach that can handle the structural differences between species (specifically apple and pear trees) throughout an entire growing season.

Methods

The researchers deployed a DJI Phantom 3 Advanced drone equipped with a Parrot Sequoia multispectral sensor, which captures light in four bands: Green (550nm), Red (660nm), Red-edge (735nm), and Near-infrared (790nm).

The core innovation of their workflow involves two types of data extraction:

  1. Reflection Features (RF): Standard spectral data and 12 different Vegetation Indices (VIs), such as NDVI and GNDVI.
  2. Texture Features (TF): Using a Gray Level Co-occurrence Matrix (GLCM), they extracted spatial patterns from the images (e.g., contrast, entropy, and homogeneity). These features provide a proxy for the physical structure of the canopy.

They compared several modeling approaches:

  • Univariate: Simple regression using a single vegetation index.
  • Multivariate Linear: Partial Least Squares (PLS) and Ridge Regression.
  • Multivariate Non-linear: Support Vector Regression (SVR) and Gaussian Process Regression (GPR).

Datasets

The study was conducted in two orchards in Baoding, China:

  • Apple Orchard: 91 "Morrissey apple" trees.
  • Pear Orchard: 96 "Bergamot pear" trees.
  • Temporal Scope: Data was collected between 2019 and 2021, covering multiple growth stages defined by the BBCH scale (from flowering to leaf senescence).
  • Ground Truth: 468 total data points of canopy SPAD values, measured using a TYS-4N chlorophyll meter and validated against laboratory chemical analysis.

Key Insights and Ideas

  • Texture is the Missing Link: Spectral data alone often fails in mixed-species scenarios because the "signal" is confused by different canopy architectures. Adding texture features (TF) significantly improved model stability, helping to "unmask" the chlorophyll signal from the structural noise.
  • The Superiority of GPR: Gaussian Process Regression outperformed other algorithms. Its Bayesian, non-parametric nature allowed it to explore "deep connections" between input features more effectively than linear models or SVR, which struggled with the high dimensionality of the fused RF+TF data.
  • GNDVI as a Baseline: For simple, single-species monitoring, the Green Normalized Difference Vegetation Index (GNDVI) remains the most effective univariate tool, though it lacks the robustness of the multivariate GPR approach.
  • Phenological Sensitivity: The models were most accurate during the peak growth and fruit maturation stages. Accuracy dipped during leaf senescence, likely due to the biochemical breakdown of chlorophyll and the thinning of the canopy.

Key Results

  • Single Species Performance: Using the RF+TF+GPR model, the researchers achieved an $R^2$ of 0.788 for apple trees and 0.723 for pear trees.
  • Mixed Species Universality: When the model was trained on a mix of both species, it maintained high accuracy, with an $R^2$ of approximately 0.76 for apple and 0.70 for pear. This is a significant jump from univariate models, which hovered around an $R^2$ of 0.2–0.35 in mixed scenarios.
  • Growth Stage Accuracy: The model remained reliable across most of the season, maintaining an $R^2 > 0.6$ during the critical third and fourth growth stages (fruit development and ripening).

Limitations and Future Work

The authors noted that the model's performance dropped significantly during the leaf senescence stage ($R^2 < 0.4$). As leaves turn yellow and fall, the background soil and branches create "inhomogeneity" that the current model cannot fully compensate for.

Additionally, while the model worked for apple and pear trees, "universality" is a bold claim. Future work will need to test this framework on a wider variety of fruit trees (like citrus or stone fruits) and explore deep learning architectures (like CNNs) that might extract even more nuanced texture features than the GLCM method used here.

Summary updated

Abstract

Chlorophyll monitoring is an important topic in phenotypic research. For fruit trees, chlorophyll content can reflect the real-time photosynthetic capacity, which is a great reference for nutrient status assessment. Traditional <i>in situ</i> estimation methods are labor- and time-consuming. Remote sensing spectral imagery has been widely applied in agricultural research. This study aims to explore a transferable model to estimate canopy SPAD across growth stages and tree species. Unmanned aerial vehicle (UAV) system was applied for multispectral images acquisition. The results showed that the univariate model yielded with Green Normalized Difference Vegetation Index (GNDVI) gave valuable prediction results, providing a simple and effective method for chlorophyll monitoring for single species. Reflection features (RF) and texture features (TF) were extracted for multivariate modeling. Gaussian Process Regression (GPR) models yielded better performance for mixed species research than other algorithm models, and the <i>R</i> <sup>2</sup> of the RF+TF+GPR model was approximately 0.7 in both single and mixed species. In addition, this method can also be used to predict canopy SPAD over various growth stages, especially in the third and fourth stages with <i>R</i> <sup>2</sup> higher than 0.6. This paper highlights the importance of using RF+TF for canopy feature expression and deep connection exploration between canopy features with GPR algorithm. This research provides a universal model for canopy SPAD inversion which can promote the growth status monitoring and management of fruit trees.
BibTeX
@inproceedings{huang2024monitoring,
  author = {Yirui Huang and Dongming Li and Xuan Liu and Zhenhui Ren},
  title = {{Monitoring canopy SPAD based on UAV and multispectral imaging over fruit tree growth stages and species}},
  booktitle = {Frontiers in Plant Science},
  year = {2024},
  doi = {10.3389/fpls.2024.1435613},
}
Figure