Transfer Learning Estimation and Transferability of LNC and LMA Across Different Datasets

Yingbo Wang, Mengzhu He, Lin Sun, Yong He, Zengwei ZhengAgriculture 2024 · DOI

TL;DR

This paper tackles the challenge of accurately estimating plant traits like leaf nitrogen concentration (LNC) and leaf mass per area (LMA) across diverse datasets using remote sensing. They introduce a novel transfer learning approach (WDT-RFR) that significantly improves estimation accuracy by intelligently updating models with data from new sources, outperforming standard transfer learning methods.

What Problem Does This Paper Address?

Estimating crucial plant ecological parameters like LNC and LMA from spectral data is vital for understanding plant health and productivity. However, models trained on one dataset often perform poorly on data from different species, locations, or measurement conditions. This "transferability gap" limits the widespread application of remote sensing for plant trait estimation. The authors aim to bridge this gap by investigating how spectral and trait data variance across datasets affects model performance and by developing a more robust transfer learning framework that can adapt to these variations.

Methods

The researchers employed a multi-pronged approach:

  • Spectral Preprocessing: They explored four common spectral preprocessing techniques (Savitzky-Golay filter, Standard Normalized Variate, Multiplicative Scatter Correction, and normalization) to reduce noise and enhance spectral features.
  • Feature Selection: The Successive Projections Algorithm (SPA) was used to identify the most informative wavelengths, reducing data redundancy and potentially improving model efficiency.
  • Transfer Component Analysis (TCA): TCA was a core technique used to quantify the spectral and trait (LNC/LMA) distance between different datasets. This helps understand how dissimilar datasets are and how this dissimilarity impacts transferability.
  • Transfer Learning Models: They evaluated standard transfer learning approaches using algorithms like Partial Least Squares Regression (PLS), Support Vector Regression (SVR), Extreme Gradient Boosting (XGB), and Random Forest Regression (RFR).
  • Novel WDT-RFR Model: The key innovation is the Weighted Distance Transfer Random Forest (WDT-RFR) model. This approach incorporates a weighted data updating strategy, where a small percentage of data from the target dataset (sorted by distance to the source) is transferred and used to update the source model. This aims to improve model adaptability and performance on new datasets.

Datasets

The study utilized six publicly available remote sensing leaf spectral reflectance datasets, encompassing a variety of plant species and collection conditions:

  • Set 1: 18 grassland species, Bethel, MN, USA (Outdoors, 2015-2016)
  • Set 2: 2 species, Arizona, USA (Outdoors, 2013)
  • Set 3: 45 species, Wisconsin, USA (Greenhouse, 2018)
  • Set 4: 1 species, USA (Greenhouse, 2012)
  • Set 5: 37 plant species, Panama & Brazil (Outdoors, 2016)
  • Set 6: 4 plant species, Belgium (Laboratory & Outdoors, 2018-2019)

These datasets provided diverse spectral characteristics and LNC/LMA values, making them suitable for testing transfer learning capabilities.

Key Insights and Ideas

  • Normalized Spectra Shine: Normalized spectral data, especially when combined with feature selection (SPA), consistently showed better performance in transfer models compared to raw or other preprocessed spectra. This suggests that normalization effectively reduces spectral noise and highlights relevant features for LNC and LMA estimation.
  • Distance Matters, But How? Both spectral and trait (LNC/LMA) distances between datasets significantly influence transfer model performance. Interestingly, LMA distance had a more pronounced impact on estimation accuracy than spectral distance alone.
  • Data Updating is Key: Simply transferring data isn't enough. The WDT-RFR model's success highlights the importance of weighted data transfer. By prioritizing data points that are closer to the source domain, the model can more effectively adapt without drastically altering the original knowledge.
  • Small Transfers, Big Gains: Transferring a small percentage (e.g., 5%) of data from the target domain to update the source model yielded the best results, suggesting a balance between adaptation and preserving the integrity of the original model.

Key Results

  • The WDT-RFR transfer model, with 5% of target data transferred, achieved an average improvement of 7.9% for LMA estimation and 4.8% for LNC estimation in terms of Root Mean Square Error (RMSE) compared to standard RFR transfer models without data updating.
  • The normalized spectral data, particularly when combined with the SPA approach, showed superior performance for LNC and LMA estimation across various transfer scenarios.
  • The study found that LMA distance had a significant influence on estimation performance, while spectral distance strongly affected LNC estimation.
  • Models using MSC and normalized spectra generally outperformed those using raw or SG/SNV preprocessed spectra.

Limitations and Future Work

  • Limited Datasets: The study utilized six datasets. The authors suggest that more diverse datasets and plant species are needed to further validate the effectiveness of their WDT-RFR model and generalize its conclusions.
  • Canopy Structure Ignored: The current model is based on leaf reflectance. For canopy-scale applications, factors like canopy structure, leaf angle distribution, and illumination/viewing geometries need to be considered.
  • Limited Traits: Only LNC and LMA were investigated. Future work could extend the model to estimate other important plant traits like carbon content, lignin, and chlorophyll.
  • Model Coupling: The authors propose exploring the integration of their approach with physical models like PROSPECT to simulate spectral data and potentially estimate traits when direct measurements are missing.

Summary updated

Abstract

Leaf mass per area (LMA) and leaf nitrogen concentration (LNC) are both essential parameters in plant ecology, which can reflect the growth status of plants. The features of LMA and LNC can be captured using spectral reflectance in a remote sensing approach. While the relationships between spectra and leaf trait variance across different species with estimation performance are unclear, the development of assessment and transferable models to predicate LMA and LNC are prevented. Hence, we analyzed the variance of raw spectra and spectral data difference with four pretreated approaches (SG—Savitzky–Golay filter, SNV—Standard Normalized Variate, MSC—Multiplicative Scatter Correction analysis, and normalize), LMA, and LNC over six remote sensing datasets by a transfer component analysis (TCA) approach. Spectra combined with the Successive Projections Algorithm (SPA) were also presented to extract wavelengths with higher important coefficients to minimize the redundancy of datasets. The variance of normalized spectra between different datasets showed a minor degree of variance, and LNC spectra variance was decreased by the SPA. The results also showed that a smaller LMA and LNC variance is presented over different datasets when the trait values with higher distribution probabilities are close to each other. The LNC and LMA estimation performance in transfer models established by partial least squares regression (PLS), support vector regression (SVR), extreme gradient boosting (XGB), and random forest regression (RFR) algorithms across different datasets were employed, in which the RFR transfer models performed good prediction results. The relationships between spectra and leaf trait variance and estimation performance in RFR transfer models over different datasets were evaluated. LMA distance has a significant influence on estimation performance in the transfer model, and the variance of spectra with all pretreated approaches showed a very significant effect on LNC accession performance. Furthermore, we proposed a weight coefficient of spectral data updating combined with the TCA and RFR approach (WDT-RFR) transfer model to improve transferability between datasets and promote estimation performance in the transfer model. Compared to the RFR transfer model using spectra without updating, the root mean square error (RMSE) of the WDT-RFR transfer model with 5% samples transferred to estimate LMA and LNC increased by 7.9% and 4.8% on average, respectively. The estimation results showed that our transfer model showed a superior estimation performance.
BibTeX
@inproceedings{wang2024transfer,
  author = {Yingbo Wang and Mengzhu He and Lin Sun and Yong He and Zengwei Zheng},
  title = {{Transfer Learning Estimation and Transferability of LNC and LMA Across Different Datasets}},
  booktitle = {Agriculture},
  year = {2024},
  doi = {10.3390/agriculture15010046},
}
Figure