Estimation of Characteristic Parameters of Grape Clusters Based on Point Cloud Data

Wentao Liu, Chenglin Wang, Yan De, Weilin Chen, Lufeng LuoFrontiers in Plant Science 2022 · DOI

This research paper, published in Frontiers in Plant Science, presents a robust 3D computer vision pipeline for accurately measuring the physical traits of grape clusters—a task traditionally made difficult by the complex, irregular geometry of the fruit.

TL;DR

Researchers have developed a high-precision 3D modeling workflow for grape bunches using Poisson surface reconstruction on multi-angle point cloud data. By combining improved registration algorithms with implicit surface modeling, they achieved a volume estimation accuracy ($R^2 = 0.9915$) that significantly outperforms traditional geometric and voxel-based methods.

What Problem Does This Paper Address?

In precision agriculture, "phenotyping"—the measurement of a plant’s physical traits—is essential for predicting yield, monitoring growth, and improving breeding. However, grape bunches are a nightmare for traditional imaging. They are characterized by "self-occlusion" (berries hiding other berries) and complex "watertight" volumes that 2D photos cannot capture.

Existing 3D methods often fall short: simple geometric models (treating a bunch like a cylinder) are too crude, while "convex hull" methods overestimate volume by ignoring the deep crevices between individual berries. This paper seeks a method that is both automated and precise enough to capture the "nooks and crannies" of a grape cluster.

Methods

The authors developed a multi-stage pipeline to transform raw sensor data into a precise digital twin:

  1. Data Acquisition: Using a Kinect v2 sensor, they scanned 16 red grape samples from 12 different angles (at 30° intervals) to ensure total coverage.
  2. Preprocessing & Segmentation: They used a region-growing algorithm to isolate the grape points from the background based on curvature and normal vectors.
  3. Improved Registration: To merge the 12 different views into one model, they used a two-step approach. First, Principal Component Analysis (PCA) provided a rough initial alignment. Then, an improved Iterative Closest Point (ICP) algorithm performed the fine-tuning. This prevents the common "ghosting" effect where misaligned points create double images.
  4. Poisson Surface Reconstruction: This is the core innovation. Unlike "explicit" methods (like Alpha-shapes) that simply connect the dots, the Poisson algorithm treats the point cloud as a continuous vector field. It solves a global equation to create a smooth, "watertight" mesh that accurately follows the contours of the berries.

Datasets

The study used a primary dataset of 16 randomly selected red grape samples (Hongti variety) of varying shapes and sizes. To validate their digital measurements, they established "ground truth" for volume using the Water Displacement Method (WDM)—manually submerging the grapes in water and measuring the overflow.

Key Insights and Ideas

  • The PCA Advantage: Standard ICP registration often fails if the starting positions of two point clouds are too far apart. By using PCA to align the coordinate systems first, the authors made the registration process much more robust and automated.
  • Implicit vs. Explicit Modeling: The paper highlights why Poisson reconstruction wins. "Explicit" methods like Alpha-shapes are highly sensitive to noise and parameter tuning; if the "alpha" value is off, the model ends up with holes or becomes a blob. Poisson reconstruction is "implicit," meaning it creates a mathematically consistent surface that handles uneven point density much better.
  • Smoothing Matters: The use of Moving Least Squares (MLS) was critical to eliminate "ghosting" artifacts, ensuring that the final volume calculation wasn't inflated by redundant, slightly misaligned points.

Key Results

The Poisson reconstruction method was compared against four common alternatives: Geometric Model (GM), 3D Convex Hull (CH), 3D Alpha-shape (AS), and Voxel-based (VB) models.

  • Volume Accuracy: The Poisson method achieved a Coefficient of Determination ($R^2$) of 0.9915.
  • Performance Gap: This was significantly higher than the next best method, the Alpha-shape ($R^2 = 0.7609$). The Voxel-based method performed the worst ($R^2 = 0.3074$), likely due to the fixed resolution of the voxels failing to capture the grape's fine details.
  • Size Estimation: The system also estimated length and width with high precision ($R^2 > 0.98$).
  • Bias: The estimated volumes were slightly larger than the true values. The authors attribute this to the fact that the camera cannot "see" the internal voids deep inside the bunch, treating the entire cluster as a solid surface.

Limitations and Future Work

  • Internal Voids: Because the method relies on surface scanning, it cannot account for empty spaces deep within the center of a dense cluster.
  • Controlled Environment: The current setup requires rotating the grape bunch 360 degrees in front of a stationary camera. This is excellent for a lab or a sorting facility but would need significant adaptation for a robot moving through a vineyard.
  • Computational Complexity: While accurate, the multi-stage registration and Poisson math are more computationally intensive than simpler models, which might impact real-time processing speeds.

Summary updated

Abstract

The measurement of grapevine phenotypic parameters is crucial to quantify crop traits. However, individual differences in grape bunches pose challenges in accurately measuring their characteristic parameters. Hence, this study explores a method for estimating grape feature parameters based on point cloud information: segment the grape point cloud by filtering and region growing algorithm, and register the complete grape point cloud model by the improved iterative closest point algorithm. After estimating model phenotypic size characteristics, the grape bunch surface was reconstructed using the Poisson algorithm. Through the comparative analysis with the existing four methods (geometric model, 3D convex hull, 3D alpha-shape, and voxel-based), the estimation results of the algorithm proposed in this study are the closest to the measured parameters. Experimental data show that the coefficient of determination (<i>R</i> <sup>2</sup>) of the Poisson reconstruction algorithm is 0.9915, which is 0.2306 higher than the coefficient estimated by the existing alpha-shape algorithm (<i>R</i> <sup>2</sup> = 0.7609). Therefore, the method proposed in this study provides a strong basis for the quantification of grape traits.
BibTeX
@inproceedings{liu2022estimation,
  author = {Wentao Liu and Chenglin Wang and Yan De and Weilin Chen and Lufeng Luo},
  title = {{Estimation of Characteristic Parameters of Grape Clusters Based on Point Cloud Data}},
  booktitle = {Frontiers in Plant Science},
  year = {2022},
  doi = {10.3389/fpls.2022.885167},
}
Figure