Efficient 3D plant segmentation through multiscale graph learning and optimized geometric processing

Jesus Ivan Ruiz-Martinez, Andres Mendez-Vazquez, Eduardo Rodriguez-TelloarXiv 2026 · arXiv

TL;DR

Researchers have developed Multiscale EdgeGAT, a compact 78,000-parameter graph attention model designed for real-time 3D plant organ segmentation. By optimizing the "hidden" costs of geometric preprocessing (like PCA and sampling), they achieved up to a 70% reduction in pipeline latency, enabling feasible inference on a Raspberry Pi 5.

What Problem Does This Paper Address?

In precision agriculture, robots and drones need to understand plant structure—distinguishing stems from leaves—to perform tasks like targeted spraying or phenotyping. While deep learning on 3D point clouds has advanced rapidly, most state-of-the-art models are too heavy for "edge" devices.

More importantly, the authors identify a critical bottleneck often ignored in research: geometric preparation. For a compact neural network, the time spent calculating local shapes (PCA) and finding neighbors (k-NN) can actually exceed the time spent on the AI inference itself. This paper tackles both the model architecture and the implementation efficiency to make on-device plant segmentation a reality.

Methods

The authors introduce Multiscale EdgeGAT, which processes 1,024 sampled points per plant.

The Model

The architecture (shown in Figure 1) uses a combination of:

  • Local Shape Descriptors: 10 PCA-based features (like planarity and sphericity) added to raw XYZ coordinates.
  • Multiscale Edge Blocks: The model looks at two neighborhood sizes ($k=8$ and $k=16$) simultaneously to capture both fine details and broader context.
  • Graph Attention: Two layers of attention to weigh the importance of neighboring features.
  • Residual Correction: A specialized branch that refines stem and leaf predictions specifically.
The Multiscale EdgeGAT architecture showing the flow from raw point cloud to segmented labels.

The "P4" Optimization

To solve the preprocessing bottleneck, the authors developed the P4 preparation pipeline. This isn't a change to the model's math, but rather a highly optimized implementation using compiled C routines for Farthest Point Sampling (FPS) and parallelized PCA/neighbor queries. This ensures that the speedups don't come at the cost of accuracy—the outputs remain bitwise identical to the original unoptimized code.

Datasets

The study evaluates the model across a wide variety of plant species and datasets:

  • Maize-focused: AO (LiDAR), Pheno4D, ZeaMays, and Single Maize.
  • Diverse Crops: PLANesT-3D (pepper, rose, currant) and PlantNet (tobacco, tomato, sorghum).
  • TomatoWUR: A specific dataset for tomato plants including semantic labels and skeletons.

Key Insights and Ideas

  • The Preprocessing Bottleneck: In their original implementation, PCA and sampling accounted for the vast majority of the runtime. On a Raspberry Pi, the "AI" part was fast, but the "geometry" part was a crawl.
  • Implementation Matters as Much as Architecture: By moving expensive operations into optimized C code and using parallel worker threads, they proved that existing representations can be made "edge-ready" without retraining or losing precision.
  • Multiscale Synergy: The ablation study showed that while PCA descriptors help, the real boost in accuracy comes from the multiscale configuration (using two neighborhood sizes), which significantly improved stem IoU (Intersection over Union).
  • Platform-Specific Tradeoffs: Interestingly, the "fastest" model changed depending on the hardware. While PointNeXt was faster on a desktop, Multiscale EdgeGAT became more competitive on the Raspberry Pi 5 due to its lower computational overhead.

Key Results

  • Compactness: The model uses only ~78k parameters, compared to over 3.8 million in the PointNeXt baseline.
  • Accuracy: On the AO maize dataset, the model achieved a mean IoU of 86.36%, performing competitively with much larger state-of-the-art models.
  • Speedup: The optimized P4 pipeline reduced total desktop latency by 70.69% on PlantNet.
  • Edge Feasibility: On a Raspberry Pi 5, the full pipeline (from raw data to labels) averaged 277.73 milliseconds for PlantNet, making it viable for near-real-time applications.
A detailed look at the relative message blocks at two neighborhood scales.

Limitations and Future Work

The authors are careful to note that "inference feasibility" is not the same as "flight readiness." * Task Specificity: The model struggled more with the TomatoWUR dataset, identifying a weakness in stem segmentation for certain plant morphologies. * Missing Metrics: The study did not measure energy consumption or battery endurance, which are critical for drone deployment. * Input Constraints: The current evaluation relies on "pre-filtered" inputs (where supports and ground are already removed). Real-world autonomous scene preparation remains a significant challenge. * Resolution: The model only predicts labels for 1,024 sampled points; future work is needed to handle dense, full-resolution reconstruction efficiently.

Summary updated

Abstract

Plant organ segmentation on compact computing platforms requires accurate predictions and affordable geometric preparation. We develop and evaluate a multiscale edge based graph attention model that combines local shape descriptors, two neighborhood scales and a residual stem and leaf correction in approximately 78 thousand parameters. The engineering application is plant point cloud segmentation for precision agriculture, assessed through grouped accuracy experiments and physical Raspberry Pi 5 inference. Broad comparisons with hierarchical, graph and transformer baselines establish PointNeXt as the strongest external accuracy reference among the tested local recipes. A nested four variant ablation on a local maize collection separates geometric information from the combined multiscale configuration across seven outer groups and three seeds. The complete model achieves the highest mean intersection over union, 86.36%, although uncertainty and boundary errors qualify the contribution of each component. We then optimize full cloud principal component analysis, sampling and neighbor queries without changing learned weights or descriptor definitions. All 1,180 paired desktop comparisons on PlantNet and TomatoWUR preserve exact logits and predictions. Multiscale pipeline latency falls from 330.33 to 96.82 milliseconds on PlantNet and from 1,054.52 to 463.10 milliseconds on TomatoWUR. PointNeXt also benefits from optimized sampling and remains faster over the complete pipeline. These results support compact graph learning with reduced geometric overhead, while physical board measurements establish inference feasibility rather than energy efficiency or readiness for autonomous flight.
BibTeX
@misc{ruizmartinez2026efficient,
  author = {Jesus Ivan Ruiz-Martinez and Andres Mendez-Vazquez and Eduardo Rodriguez-Tello},
  title = {{Efficient 3D plant segmentation through multiscale graph learning and optimized geometric processing}},
  year = {2026},
  eprint = {2611.11007},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.11007},
}
Figure