Vision-Based Defect Classification and Weight Estimation of Rice Kernels

Xiang Wang, Kai Wang, Xiaohong Li, Shiguo Lian

TL;DR

Researchers have developed an automated, vision-based system that classifies rice kernel defects and estimates their weight ratios with high precision. By combining a multi-stage deep learning workflow (YOLOv5 and ResNeXt) with a novel "weight-per-pixel" metric, the system achieves over 85% classification precision and keeps weight estimation errors under 2%, effectively replacing tedious manual inspections.

What Problem Does This Paper Address?

Rice quality grading is a high-stakes task in agriculture, affecting both food safety and market pricing. Traditionally, this is done manually: inspectors painstakingly sort kernels one by one to identify flaws like chalkiness, spots, or breakage, then weigh the groups to determine quality ratios.

This manual process is slow, subjective, and prone to human error. While computer vision has been tried before, two major hurdles remained:

  1. Dual Defects: A single grain of rice can have multiple flaws (e.g., being both broken and chalky). Standard "single-label" classifiers struggle to categorize these accurately.
  2. Weight Estimation from Images: Quality is measured by weight ratios, but cameras see area, not mass. Estimating weight purely from 2D images is difficult because different types of rice defects change the kernel's density and transparency.

Methods

The authors proposed an integrated hardware and software solution:

1. Controlled Hardware Setup

To minimize noise, they designed a specialized imaging box featuring a white dome light for even illumination and a non-reflective black mat. This ensures that the visual features of the rice (like glossiness and internal chalky structures) are captured consistently.

2. Multi-Stage Classification Workflow

Instead of a single "black box" model, the system uses a branched approach:

  • Branch A (General Defects): A YOLOv5 model identifies "Sound" (perfect), "Broken," "Spotted," and "Yellow-Colored" kernels from the color image.
  • Branch B (Chalky Defects): Chalkiness is often clearer in grayscale. The system converts the image to grayscale, uses a second YOLOv5 model to locate chalky kernels, segments them, and then uses a ResNeXt classifier to distinguish between "Partial-Chalky" (PC) and "Mass-Chalky" (MC).
  • Fusion Stage: The results are merged. If a kernel is detected by both branches, it is flagged with "dual properties," allowing the system to handle complex, multi-defect grains.

3. Weight-per-Pixel Metric

To solve the weight estimation problem without expensive 3D sensors, the authors introduced a weight-per-pixel metric ($\rho_t$). They pre-calculated the average density (weight divided by 2D projected area) for each defect type. By multiplying the segmented pixel area of a kernel by its class-specific density, the system can estimate the total weight ratio of the sample.

Datasets

The study used a custom dataset of 322 high-resolution images, each containing between 40 and 80 rice kernels.

  • Annotation: Every kernel was manually labeled by professional inspectors with years of experience.
  • Diversity: The dataset includes six primary categories: Sound (SO), Partial-Chalky (PC), Mass-Chalky (MC), Yellow-Colored (YC), Spotted (SP), and Broken (BR), along with various dual-property combinations.

Key Insights and Ideas

  • Grayscale for Chalkiness: One of the "aha" moments was realizing that color information can actually obscure chalky regions. Converting to grayscale and using a dedicated branch for chalky detection significantly boosted accuracy for those specific defects.
  • Handling Data Imbalance: Dual-property kernels are rare. Instead of creating a new category for every possible combination (which would lead to a "long tail" data problem), the authors treated dual-property kernels as two separate entities during training. This allowed the model to learn the features of each defect independently.
  • Density Matters: The research confirmed that "Sound" rice and "Broken" rice have different projected densities. Using a single density value for all kernels leads to high errors; class-specific density is the key to accurate weight estimation from 2D images.

Key Results

The system was evaluated using 5-fold cross-validation and compared against standard YOLOv5 baselines:

  • Classification Accuracy: The proposed model achieved over 90% precision for Sound, Broken, Yellow, and Spotted kernels. Even the difficult Mass-Chalky category saw significant improvements in recall.
  • Weight Estimation: The mean error for weight ratio estimation was less than 2% across all defect types, with a maximum error of less than 3%.
  • Efficiency: The system provides a contactless, automated output that is far faster than manual sorting and weighing.

Limitations and Future Work

While the results are promising, the authors note a few areas for improvement:

  • Fixed Geometry: The current weight estimation assumes a fixed distance between the camera and the mat. Any change in the hardware setup would require recalibrating the weight-per-pixel metrics.
  • Overlapping Kernels: The system currently relies on kernels being scattered manually with few overlaps. Future iterations could benefit from more robust segmentation to handle "clumped" rice.
  • Dataset Scale: While 322 images provided good results, expanding the dataset to include more rice varieties and environmental conditions would improve the model's generalizability.

Summary updated

Abstract

Rice is one of the main staple food in many areas of the world. The quality estimation of rice kernels are crucial in terms of both food safety and socio-economic impact. This was usually carried out by quality inspectors in the past, which may result in both objective and subjective inaccuracies. In this paper, we present an automatic visual quality estimation system of rice kernels, to classify the sampled rice kernels according to their types of flaws, and evaluate their quality via the weight ratios of the perspective kernel types. To compensate for the imbalance of different kernel numbers and classify kernels with multiple flaws accurately, we propose a multi-stage workflow which is able to locate the kernels in the captured image and classify their properties. We define a novel metric to measure the relative weight of each kernel in the image from its area, such that the relative weight of each type of kernels with regard to the all samples can be computed and used as the basis for rice quality estimation. Various experiments are carried out to show that our system is able to output precise results in a contactless way and replace tedious and error-prone manual works.
BibTeX
@article{wang2022vision,
  author = {Xiang Wang and Kai Wang and Xiaohong Li and Shiguo Lian},
  title = {{Vision-Based Defect Classification and Weight Estimation of Rice Kernels}},
  journal = {IEEE Access},
  year = {2022},
  doi = {10.1109/access.2022.3223137},
}

Loading related content...

Figure