OccFiner: Offboard Occupancy Refinement with Hybrid Propagation

Hao Shi, Song Wang, Jiaming Zhang, Xiaoting Yin, Zhongdao Wang, Zhijian Zhao, Guangming Wang, Jianke Zhu, Kailun Yang, Kaiwei Wang

Abstract

Vision-based occupancy prediction, also known as 3D Semantic Scene Completion (SSC), presents a significant challenge in computer vision. Previous methods, confined to onboard processing, struggle with simultaneous geometric and semantic estimation, continuity across varying viewpoints, and single-view occlusion. Our paper introduces OccFiner, a novel offboard framework designed to enhance the accuracy of vision-based occupancy predictions. OccFiner operates in two hybrid phases: 1) a multi-to-multi local propagation network that implicitly aligns and processes multiple local frames for correcting onboard model errors and consistently enhancing occupancy accuracy across all distances. 2) the region-centric global propagation, focuses on refining labels using explicit multi-view geometry and integrating sensor bias, especially to increase the accuracy of distant occupied voxels. Extensive experiments demonstrate that OccFiner improves both geometric and semantic accuracy across various types of coarse occupancy, setting a new state-of-the-art performance on the SemanticKITTI dataset. Notably, OccFiner elevates vision-based SSC models to a level even surpassing that of LiDAR-based onboard SSC models.
BibTeX
@article{shi2025occfiner,
  author = {Hao Shi and Song Wang and Jiaming Zhang and Xiaoting Yin and Zhongdao Wang and Zhijian Zhao and Guangming Wang and Jianke Zhu and Kailun Yang and Kaiwei Wang},
  title = {{OccFiner: Offboard Occupancy Refinement with Hybrid Propagation}},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2025},
  url = {https://openreview.net/forum?id=Kd0BdOmjm1},
}
Figure