DualCMNet: a lightweight dual-branch network for maize variety identification based on multi-modal feature fusion

Xinhua Bi, Hao Xie, Ziyi Song, Jinge Li, Chang Liu, Xiaozhu Zhou, Helong Yu, Chunguang Bi, Ming ZhaoFrontiers in Plant Science 2025 · DOI

Abstract

Identifying maize varieties accurately is a cornerstone of seed quality control and modern breeding. However, many varieties exhibit high morphological similarity, making visual identification alone insufficient. This paper introduces DualCMNet, a lightweight, dual-branch deep learning framework that fuses RGB images with hyperspectral signals. By optimizing for both accuracy and computational efficiency, the model achieves a 98.75% accuracy rate with only 2.53 million parameters. This design is specifically tailored for deployment on edge computing devices, facilitating real-time, in-field identification for smart agriculture.

The Challenge of Morphological Similarity

In the agricultural sector, distinguishing between maize varieties is critical but difficult. Many varieties appear nearly identical to the human eye or standard computer vision systems, necessitating the use of internal chemical data alongside visual cues.

ZD958 maize kernel

Traditional identification methods generally fall into two categories:

  1. Computer Vision (RGB): Effective at capturing external features like shape and color but fails when varieties share high morphological similarity.
  2. Spectral Analysis: Captures internal physicochemical properties (e.g., starch, protein, fat) but is susceptible to environmental noise.

While multimodal models combining these data types exist, they are often too computationally heavy for portable, battery-powered IoT devices used in the field.

Methodology: The DualCMNet Architecture

DualCMNet employs a parallel architecture to process spatial and spectral data simultaneously:

  • Spatial Branch: Utilizes MobileNetV3-Small, a state-of-the-art lightweight architecture, to extract features from RGB images.
  • Spectral Branch: Uses a 1D-Convolutional Neural Network (1D-CNN) to process 2,151-dimensional hyperspectral data (350–2500 nm).
  • HShuffleBlock: A novel module that uses grouped linear transformations and channel shuffling to align dimensions and encourage information interaction between branches without significantly increasing parameter count.
  • CBAM (Convolutional Block Attention Module): Focuses the model on critical morphological features and significant wavelength bands.
  • Lightweight Gated Fusion: Dynamically weights the importance of spectral vs. spatial features for each sample, allowing the model to prioritize the most reliable data source for a given variety.

Experimental Results

The model was tested on a custom dataset of 11 maize varieties (11,000 kernels total). The study confirmed that multimodal fusion significantly outperforms single-modal approaches; the baseline fusion (96.83%) surpassed the best single-modal model (94.54%), while DualCMNet's optimizations pushed performance even higher.

Key performance metrics include:

  • Accuracy: 98.75% (5-fold cross-validation).
  • Efficiency: Only 2.53M parameters and 75.40M FLOPs, significantly smaller and faster than standard models like ResNet34.
  • Ablation Study: The gated fusion module improved accuracy by 1.25% over simple concatenation, proving the value of dynamic feature weighting.

Conclusion and Future Directions

DualCMNet provides an efficient solution for real-time maize variety identification. While currently tested in laboratory settings, future work will focus on:

  • Field Robustness: Adapting the model to handle variable lighting and environmental conditions.
  • Feature Reduction: Using band selection algorithms to reduce hyperspectral input dimensions, further lowering hardware costs.
  • Cross-Crop Application: Extending the framework to other crops like rice and wheat.

This research establishes a universal framework for crop variety classification, bridging the gap between high-accuracy deep learning and practical field deployment.

Summary updated

Abstract

This lightweight design enables the model to be deployed in edge computing devices, allowing for real-time identification in the field, thus meeting the practical application requirements in agricultural Internet of Things and smart agriculture scenarios. This study not only provides an accurate and efficient solution for maize seed variety identification but also establishes a universal framework that can be extended to variety classification tasks of other crops.
BibTeX
@inproceedings{bi2025dualcmnet,
  author = {Xinhua Bi and Hao Xie and Ziyi Song and Jinge Li and Chang Liu and Xiaozhu Zhou and Helong Yu and Chunguang Bi and Ming Zhao},
  title = {{DualCMNet: a lightweight dual-branch network for maize variety identification based on multi-modal feature fusion}},
  booktitle = {Frontiers in Plant Science},
  year = {2025},
  doi = {10.3389/fpls.2025.1588901},
}
Figure