FOSCo-Net: Ego-centric Voxel Completion for Forest LiDAR Occlusions

Iman Esfandiyar, Dominik BelterarXiv 2026 · arXiv

TL;DR

FOSCo-Net is a self-supervised deep learning framework that allows robots to "see" through tree trunks by predicting occluded geometry from a single LiDAR scan. By using temporal scan accumulation as an automatic supervisor, it significantly improves navigation safety in dense forests without requiring any manual data labeling.

What Problem Does This Paper Address?

Navigating a robot through a dense forest is a nightmare for standard occupancy mapping. Spinning LiDAR sensors are the workhorse of forest robotics, but they suffer from systematic occlusion shadows. Every tree trunk acts like a pillar, blocking the sensor's "vision" and creating wedge-shaped gaps of unknown space behind it.

For an autonomous planner, these gaps are a lose-lose scenario. If the planner assumes unknown space is free, the robot might collide with a hidden obstacle. If it assumes it is occupied (the conservative approach), the map becomes a series of disconnected "islands" of free space, often leaving the robot with no valid path to follow. FOSCo-Net aims to turn these "unknown" voxels into confident estimates of free or occupied space, effectively "hallucinating" the geometry behind the trunks to enable safe routing.

![Fig.

  1. Single LiDAR scan in a temperate forest showing the occlusion shadow behind a tree trunk.](/figures/art_77cf48f763674c64a0734bd78a2f4037)

Methods

The authors propose a self-supervised voxel completion framework. The key innovation is how the model learns without human intervention:

  1. Self-Supervision via Motion: During training, the system registers and merges multiple LiDAR scans from a temporal window (past and future) to create a "complete" local map. The network is then trained to take a single sparse scan as input and predict the missing geometry found in the accumulated map.
  2. Ego-centric Representation: The model operates on a sensor-centered, yaw-aligned grid. This makes the learned features pose-invariant—the network sees the "world" the same way regardless of the robot's absolute position.
  3. Sparse-to-Dense Architecture: Since LiDAR data is incredibly sparse (only ~0.7% of voxels are typically occupied), the encoder uses submanifold sparse convolutions to process only the points where data actually exists.
  4. Gated Skip Decoder: The authors introduced a novel "Gated Skip" architecture. It uses a gating mechanism ($\sigma$-gated skip connections) that vanishes at unobserved positions. This forces the decoder to anchor its predictions to observed surfaces, preventing the "hallucination" of obstacles in empty air far from any real data.
Fig. 2. Self-supervised training and inference pipeline. Top: LiDAR frames from a temporal window [T−∆, T+∆] are registered into the frame at T to form the dense supervision target. Bottchaom: at inference only the single scan at T is available.

Datasets

The study utilizes the DigiForests dataset, a longitudinal LiDAR dataset specifically designed for forestry robotics. The authors extracted 50 ego-centric sample pairs from a single sequence to train and test their models, demonstrating that the self-supervised approach is highly data-efficient.

Key Insights and Ideas

  • Architecture Trumps Grid Choice: The researchers compared Cylindrical grids (which match the native geometry of spinning LiDAR) against standard Cartesian grids. Surprisingly, they found that the specific decoder design (like the Gated Skip) had a much larger impact on performance than the choice of coordinate system.
  • The SFPR Metric: Standard computer vision metrics like Intersection-over-Union (IoU) don't capture the nuances of robotic safety. The authors introduced the Shadow False Positive Rate (SFPR). This metric specifically measures how often the model incorrectly predicts an obstacle in the traversable corridor behind a trunk—the exact error that would cause a robot to get stuck.
  • Spatial Anchoring: By using sparse convolutions, the encoder produces activations that are spatially "anchored" to real surface observations. This leads to much tighter, more accurate predictions of trunk geometry compared to dense baselines that tend to "smear" predictions across neighboring voxels.

Key Results

FOSCo-Net (specifically the Gated Skip variant) consistently outperformed established baselines like LMSCNet and MIDUNet2D:

  • Safety: It reduced the SFPR by a factor of 2.1 compared to MIDUNet2D (0.346 vs 0.741). In practical terms, FOSCo-Net blocks only 35% of traversable corridors with false obstacles, whereas the baseline blocks 74%, making it far more useful for path planning.
  • Precision: It achieved a +17.6% improvement in precision over the best baseline.
  • Efficiency: The model achieves these results with a comparable parameter budget (~1.90M parameters) and runs in real-time on modern hardware.
Qualitative comparison of FOSCo-Net predictions on cylindrical and Cartesian grids.

Limitations and Future Work

While promising, the current work has a few areas for growth:

  • Generalization: The model was trained and tested on a limited set of forest sequences. Future work will involve testing across diverse forest types and tree species.
  • Uncertainty Awareness: The authors suggest extending the Gated Skip decoder to provide uncertainty-aware predictions, allowing a planner to be more cautious when the model is less confident.
  • Integration: The next logical step is direct integration into the motion planning stack of an agricultural or forestry robot to measure the real-world impact on mission success rates.

Summary updated

Abstract

Ground robots operating in temperate forests suffer from systematic LiDAR occlusions caused by tree trunks, creating persistent blind regions that degrade traversability estimation. In this paper, we propose FOSCo-Net, a self-supervised voxel completion framework that learns to reconstruct occluded geometry from a single scan using temporally accumulated observations as automatic supervision, and we evaluate cylindrical and Cartesian ego-centric grids with multiple decoder designs. FOSCo-Net consistently improves reconstruction quality and traversal safety, with a gated skip decoder achieving the most reliable performance and significantly reducing false obstacle predictions compared to baselines.
BibTeX
@misc{esfandiyar2026fosco,
  author = {Iman Esfandiyar and Dominik Belter},
  title = {{FOSCo-Net: Ego-centric Voxel Completion for Forest LiDAR Occlusions}},
  year = {2026},
  eprint = {2611.06588},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.06588},
}
Figure