Screening and functional prediction of differentially expressed genes in walnut endocarp during hardening period based on deep neural network under agricultural internet of things

Zhongzhong Guo, Shangqi Yu, Jiazhi Fu, Kai Ma, Rui ZhangPLoS 2022 · DOI · OpenAlex

TL;DR

Researchers have developed a hybrid deep learning model combining Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks to predict gene expression and function during walnut shell hardening. This approach achieves over 92% accuracy, significantly outperforming traditional machine learning methods and providing a high-tech roadmap for breeding better, thin-shelled walnuts.

What Problem Does This Paper Address?

In the world of agriculture, the "paper walnut" (thin-shelled) is a high-value crop, but breeding these varieties requires a deep understanding of endocarp (shell) hardening. This hardening is driven by complex gene expressions and lignin deposition over time.

The challenge lies in the data. Traditional screening algorithms often suffer from low accuracy when trying to identify which genes are "differentially expressed" (turned on or off) during specific growth stages. Because biological processes are both sequential and spatially complex, standard models struggle to capture the full picture. The authors sought to bridge this gap by applying a deep learning architecture capable of handling both the structural patterns of genetic sequences and their temporal changes.

Methods

The researchers took a two-pronged approach: biological observation and computational modeling.

  1. Biological Observation: They tracked lignin deposition in "paper walnuts" at 50, 57, 78, and 90 days after flowering using phloroglucinol staining and microscopy. This established a ground-truth timeline for when hardening actually occurs.
  2. The Hybrid Model (CNN + LSTM):
    • CNN Layer: Used to extract local, spatial features from gene sequences. By treating genetic data like an image or a grid, the CNN identifies specific "motifs" or patterns within the RNA.
  3. LSTM Layer: Since gene expression is a time-dependent process, the LSTM (a type of Recurrent Neural Network) was used to capture the temporal dependencies across the four growth stages.
  4. Data Encoding: To make the biological data "readable" for the AI, they used four-bit one-hot encoding. Each of the four RNA bases (A, U, G, C) was converted into a unique binary vector (e.g., A = [1,0,0,0]), resulting in a 16x4 matrix for each gene sequence.

Datasets

The study utilized a robust dataset derived from transcriptome and proteome sequencing of walnut endocarp samples:

  • Initial Data: 77,570 mRNA sequences and 6,776 protein expression data points.
  • Time Points: Samples were collected at 50, 57, 78, and 90 days post-flowering.
  • Training/Test Split: The data was divided into a 9:1 ratio for training and validation.
  • Benchmarks: The model was compared against traditional algorithms including Support Vector Machines (SVM), XGBoost, Random Forest, and standalone CNNs.

Key Insights and Ideas

  • Outside-In Hardening: Microscopic results revealed that walnut shells don't harden all at once. Hardening begins at the top tip around day 57 and progresses laterally from the outside of the shell toward the inside.
  • The Power of Hybridization: The "aha" moment of the paper is the synergy between CNN and LSTM. While a standalone CNN is good at identifying what a gene sequence looks like, the LSTM understands when and how that sequence matters in a timeline. This combination is what pushed the accuracy past the 90% mark.
  • Agricultural IoT Integration: The study frames this within the "Agricultural Internet of Things," suggesting that these deep learning models can eventually be integrated into automated systems for real-time crop monitoring and precision breeding.

Key Results

The CNN + LSTM composite model proved superior across every metric:

  • Accuracy: Reached a peak of 0.9264.
  • AUC (Area Under Curve): Achieved a score of 0.9796, indicating near-perfect classification performance. For comparison, the SVM model only reached 0.8665.
  • Efficiency: The hybrid model demonstrated the smallest error rates and shorter iteration times compared to traditional machine learning models.
  • Validation: Five-fold cross-validation confirmed that the model maintained a steady accuracy of around 92% and a loss value below 0.2.

Limitations and Future Work

The authors identify a few areas for improvement:

  • Redundant Data: The current data collection process includes some redundant information that wasn't fully filtered out before being fed into the model.
  • Organizational Complexity: While the model is excellent at screening genes, the authors suggest that future research should focus on using deep learning to predict the broader "organizational structure" of how these genes interact within the plant tissue.
  • Scalability: While successful for walnuts, the model needs to be tested on other woody oil crops to prove its generalizability in the field of agricultural bioinformatics.

Summary updated

Abstract

The deep neural network is used to establish a neural network model to solve the problems of low accuracy and poor accuracy of traditional algorithms in screening differentially expressed genes and function prediction during the walnut endocarp hardening stage. The paper walnut is used as the research object to analyze the biological information of paper walnut. The changes of lignin deposition during endocarp hardening from 50 days to 90 days are observed by microscope. Then, the Convolutional Neural Network (CNN) and Long and Short-term Memory (LSTM) network model are adopted to construct an expression gene screening and function prediction model. Then, the transcriptome and proteome sequencing and biological information of walnut endocarp samples at 50, 57, 78, and 90 days after flowering are analyzed and taken as the training data set of the CNN + LSTM model. The experimental results demonstrate that the endocarp of paper walnut began to harden at 57 days, and the endocarp tissue on the hardened inner side also began to stain. This indicates that the endocarp hardened laterally from outside to inside. The screening and prediction results show that the CNN + LSTM model's highest accuracy can reach 0.9264. The Accuracy, Precision, Recall, and F1-score of the CNN + LSTM model are better than the traditional machine learning algorithm. Moreover, the Receiver Operating Curve (ROC) area enclosed by the CNN + LSTM model and coordinate axis is the largest, and the Area Under Curve (AUC) value is 0.9796. The comparison of ROC and AUC proves that the CNN + LSTM model is better than the traditional algorithm for screening differentially expressed genes and function prediction in the walnut endocarp hardening stage. Using deep learning to predict expressed genes' function accurately can reduce the breeding cost and significantly improve the yield and quality of crops. This research provides scientific guidance for the scientific breeding of paper walnut.
BibTeX
@inproceedings{guo2022screening,
  author = {Zhongzhong Guo and Shangqi Yu and Jiazhi Fu and Kai Ma and Rui Zhang},
  title = {{Screening and functional prediction of differentially expressed genes in walnut endocarp during hardening period based on deep neural network under agricultural internet of things}},
  booktitle = {PLoS},
  year = {2022},
  doi = {10.1371/journal.pone.0263755},
}

Loading related content...

Figure