Abstract
Individual Tree Crown (ITC) segmentation is a critical task in precision forestry for monitoring biomass and biodiversity. However, existing algorithms are often specialized for specific sensors (e.g., airborne vs. terrestrial LiDAR), limiting their transferability. We present SegmentAnyTree, a deep learning framework that achieves platform agnosticism through a novel "synthetic sparsification" augmentation strategy. Our model outperforms current state-of-the-art methods by 20–30% in accuracy and is significantly more computationally efficient, providing a robust solution for multi-sensor forest inventories.
Introduction
In precision forestry, the ability to segment individual trees from LiDAR data is essential for detailed forest management. Traditionally, researchers have relied on platform-specific algorithms. Airborne Laser Scanning (ALS/ULS) methods typically use top-down perspectives and struggle with sparse understory data. In contrast, Terrestrial (TLS) and Mobile (MLS) methods are optimized for high-density, ground-up scans. This fragmentation necessitates constant model re-tuning. SegmentAnyTree addresses this by providing a single, unified model capable of processing data from any LiDAR platform.
Methodology
The SegmentAnyTree architecture is based on PointGroup, a 3D convolutional neural network (CNN) utilizing the Minkowski Engine for sparse data processing. The model employs three parallel prediction heads: semantic segmentation (tree vs. non-tree), offset prediction (pointing to tree centers), and an embedding space to differentiate individual instances.
The core innovation lies in the synthetic sparsification augmentation strategy. By training on high-density scans that are randomly subsampled to various densities (from 1000 down to 10 points/m²), the model learns abstract geometric features of trees that are invariant to point density.
Datasets and Evaluation
The model was validated across several diverse benchmarks:
- FOR-instance: A global UAV (ULS) dataset.
- Wytham Woods: A complex TLS dataset of temperate deciduous forests.
- TreeLearn: An MLS dataset focusing on mature Beech forests.
- LAUTx: A multi-layered forest inventory used for direct comparison with state-of-the-art (SOTA) methods like Point2Tree and TLS2trees.
Key Results
SegmentAnyTree demonstrated significant improvements over existing methods:
- Accuracy: On the LAUTx dataset, the model achieved a 20–30% improvement in F1 score and detection rates compared to Point2Tree.
- Understory Detection: The model showed a marked increase in the detection of trees under 10 meters, which are often missed by traditional canopy-height-model (CHM) based methods.
- Efficiency: The approach is approximately 10x more computationally efficient than graph-based alternatives.
- Robustness: Performance remains stable down to a density of 50 points/m², with a sharp decline only occurring at extremely low densities (10 points/m²).
Discussion and Limitations
A key insight from this research is that "sparsity is a feature." Aggressive augmentation with sparse data actually improved the model's performance on high-resolution datasets by forcing it to learn more robust structural representations.
However, challenges remain in complex, multi-layered broadleaved forests where intertwined crowns make segmentation difficult even for human experts. Future work will focus on expanding the training data to include tropical ecosystems and exploring specialized convolutional kernels to better capture vertical tree structures.
Conclusion
SegmentAnyTree represents a significant step toward a universal tool for forest inventory. By breaking the "sensor silo," it enables practitioners to apply a single, high-performance model across various LiDAR platforms, streamlining the path from raw data to actionable forest metrics.
Summary updated