Overcoming small minirhizotron datasets using transfer learning

Weihuang Xu, Guohao Yu, Alina Zare, Brendan Zurweller, Diane Rowland, Joel Reyes-Cabrera, Felix B. Fritschi, Roser Matamala, Thomas E. Juenger

TL;DR

This paper demonstrates that transfer learning using a domain-specific dataset (peanut roots) significantly outperforms general-purpose pre-training (ImageNet) for segmenting plant roots in minirhizotron imagery. By leveraging features from a moderate-sized related dataset, the researchers achieved over 99% segmentation accuracy on a target switchgrass dataset using only 21 training images.

What Problem Does This Paper Address?

Studying plant root systems is vital for agriculture and climate science, but it’s notoriously difficult. Minirhizotron technology uses cameras inserted into clear tubes in the soil to capture non-invasive, in-situ images of roots. However, the "standard" way to analyze these images is manual tracing—a process the authors describe as "extremely tedious and time-consuming."

While deep learning offers a path to automation, it typically requires massive amounts of annotated data. In the niche world of plant phenotyping, such datasets are rare. This paper tackles the "small data" problem: how can we build highly accurate root segmentation models when we only have a handful of labeled images for a specific plant species?

Methods

The researchers employed a U-Net architecture, a standard for semantic segmentation that uses an encoder-decoder structure with skip connections to preserve spatial detail.

The U-Net architecture used for pixel-wise root segmentation.

The core of their approach was a comparative study of transfer learning strategies. They tested four model variants on a tiny switchgrass dataset:

  1. S-model: Trained from scratch with random initialization.
  2. I-model: Encoder initialized with weights pre-trained on the massive, general-purpose ImageNet dataset.
  3. P-En-model: Encoder initialized with weights pre-trained on a domain-specific peanut root dataset.
  4. P-EnDe-model: Both the encoder and the decoder initialized with weights from the peanut root dataset.

Datasets

The study utilized two primary datasets:

  • Peanut Root Dataset: A moderate-scale dataset compiled by the authors containing 17,550 RGB images (760 x 580 pixels) with manually labeled ground truth masks.
  • Switchgrass Root Dataset: A very small dataset consisting of only 28 high-resolution images (2160 x 1560 pixels). This served as the challenging "target" for transfer learning.
Examples of peanut root images and their manually labeled ground truth.

Key Insights and Ideas

  • Relevance Trumps Scale: While ImageNet is orders of magnitude larger than the peanut dataset, the features learned from peanut roots were far more effective for segmenting switchgrass roots. This suggests that for specialized scientific imaging, "discipline-specific" pre-training is superior to general-purpose pre-training.
  • Pre-train the Whole Network: Most transfer learning only focuses on the encoder (the "backbone"). This paper found that pre-training the decoder as well (the P-EnDe model) led to the best performance and highest stability.
  • Correcting Human Error: Interestingly, the deep learning models were robust enough to "correct" errors in the manual ground truth, such as gaps between labeled rectangles or inconsistent root widths in the training masks.
  • Faster Convergence: Models using domain-specific transfer learning converged much faster and showed significantly less variance across different training trials compared to models trained from scratch or with ImageNet weights.

Key Results

  • Peanut Dataset Performance: The best U-Net model (depth 6) achieved a pixel-level accuracy of 99.04% (measured by Area Under the ROC Curve).
  • Switchgrass Transfer Success: Using only 21 images for fine-tuning, the peanut-pre-trained model achieved 99% accuracy.
  • Quantitative Edge: The P-EnDe model reached an average AUC of 0.994 for ROC curves and 0.790 for Precision-Recall (PR) curves, vastly outperforming the model trained from scratch (AUC of 0.870 and 0.425, respectively).
ROC curves showing the performance of different U-Net depths on the peanut dataset.
Precision-Recall curves illustrating that peanut-pre-trained models (Green/Red) maintain much higher precision at high recall levels compared to ImageNet (Orange) or scratch (Blue) models.

Limitations and Future Work

The primary limitation is the extremely small size of the target switchgrass dataset (28 images), though the results successfully proved the efficacy of transfer learning in such constrained scenarios.

The authors suggest that their model could be integrated into existing annotation tools (like rhizoTrak) to provide "pre-segmentations." Human technicians would then only need to correct minor errors, drastically reducing the manual labor required to build even larger, more diverse root datasets in the future.

Summary updated

Abstract

Highlights•We compiled two datasets of peanut and switchgrass root imagery for this study.•Well-trained model overcame errors in human-labeled ground truth masks.•With small datasets, transfer learning is effective to improve model performance.•Both pre-trained encoder and decoder help with performance in U-net based model.•The relevance of pre-trained dataset is more important than the size.
BibTeX
@article{xu2020overcoming,
  author = {Weihuang Xu and Guohao Yu and Alina Zare and Brendan Zurweller and Diane Rowland and Joel Reyes-Cabrera and Felix B. Fritschi and Roser Matamala and Thomas E. Juenger},
  title = {{Overcoming small minirhizotron datasets using transfer learning}},
  journal = {Comput. Electron. Agric.},
  year = {2020},
  doi = {10.1016/j.compag.2020.105466},
}

Loading related content...

Figure