Local-Global Joint Modeling for Point Cloud Super-Resolution Guided by Multi-Scale Spatial Priors

Wang Yang, Wenyi GearXiv 2026 · arXiv

TL;DR

This paper introduces a novel framework for LiDAR point cloud super-resolution that treats sparse 3D data as structured 2D range images. By combining local convolutional filters with global State-Space Models (Mamba) and applying vertical spatial priors, the authors achieve state-of-the-art reconstruction quality, effectively eliminating the "over-smoothing" and "spike artifacts" that plague traditional methods.

What Problem Does This Paper Address?

LiDAR sensors are essential for autonomous driving, but they have a physical limitation: point density drops significantly as distance increases. This leaves distant objects sparse and blurry, hindering precise perception.

To fix this, researchers often use range-image-based super-resolution, projecting 3D points onto a 2D grid (like a panoramic photo where each pixel is a distance value). However, this approach faces three major hurdles:

  1. Vertical Nonuniformity: The top of a range image (distant sky/background) is much sparser and noisier than the bottom (nearby road), yet standard models treat them the same.
  2. The Smoothing Dilemma: Purely convolutional networks have small "receptive fields" and miss global context, while global attention models often over-smooth sharp edges, like the crisp outline of a car.
  3. Back-Projection Spikes: When converting a smoothed 2D image back into 3D space, tiny interpolation errors at object boundaries turn into giant "spikes" or floating artifacts.
Fig. 1. Illustration of the point cloud over-smoothing problem

Methods

The authors propose a three-pronged architecture to tackle these issues:

  • LG-SSM Block (Local-Global Joint Modeling): This is the core engine. It uses depthwise separable convolutions to capture sharp local edges and textures, then passes the features to a Selective State-Space Model (SSM)—specifically inspired by the Mamba architecture. The SSM establishes long-range dependencies across the entire panoramic image with linear complexity, balancing fine detail with global consistency.
  • SpatialGateFuse: Instead of simple skip-connections, this module uses a "vertical spatial prior." It applies a gated mask that recognizes the upper part of the image is less reliable. It adaptively enhances features in these sparse regions to prevent noise from polluting the decoder.
  • 2D Median-Residual Denoising: A clever post-processing step. Before the final 3D back-projection, the model compares predicted depths against a local median. If a pixel deviates too much (a sign of an interpolation artifact), it is filtered out, preventing 3D "spikes."
Overall network architecture

Datasets

The model was trained and evaluated on two industry-standard autonomous driving datasets:

  • KITTI-360: The authors downsampled 64-beam LiDAR scans to 16 beams for input, tasking the model with reconstructing the original 64-beam density.
  • nuScenes: A more challenging setup where 8-beam inputs were upsampled to a 32-beam target resolution.

Key Insights and Ideas

  • Mamba for LiDAR: While Transformers are popular for global modeling, their quadratic complexity is a burden for high-resolution range images. The use of SSMs (Mamba) allows for global context with the efficiency of a CNN.
  • Geometry-Aware Fusion: The "aha moment" here is realizing that a range image isn't just a picture; it's a projection of a physical scan. By baking the vertical scanning geometry (the "vertical prior") into the fusion process, the model learns to be skeptical of noisy, distant data.
  • Denoising in 2D for 3D Gains: Most denoising happens in 3D space, which is computationally expensive. This paper proves that identifying "anomalous residuals" in the 2D image domain is a highly effective and cheaper way to prevent 3D artifacts.
Illustration of 2D median-residual denoising

Key Results

The proposed method outperformed several recent baselines, including TULIP, SRFormer, and SRMamba, across both 2D and 3D metrics.

  • KITTI-360: Achieved an IoU (Intersection over Union) of 0.4703, a significant jump over SRMamba (0.4389). It also halved the Chamfer Distance (CD) compared to most competitors, indicating much higher 3D structural accuracy.
  • nuScenes: Reached an IoU of 0.3593, maintaining a lead even in very sparse (8-beam) scenarios.
  • Qualitative Success: Visual results show that the method preserves the gaps between scan lines on the road and the sharp silhouettes of vehicles, whereas other methods often "melt" these structures together.

Limitations and Future Work

Not discussed in the paper. However, typical challenges for this type of work include the computational overhead of the SSM blocks compared to simple CNNs and the potential sensitivity to specific LiDAR calibration parameters when projecting range images.

Summary updated

Abstract

Range-image-based point cloud super-resolution provides an effective way to reconstruct sparse outdoor point clouds by projecting low-resolution LiDAR scans into a regular 2D representation. However, current methods still face three challenges. First, range images exhibit pronounced vertical nonuniformity, with sparse observations in distant regions and denser observations in nearby regions. Some cross-scale fusion mechanisms do not account for the varying reliability of features at different vertical positions, allowing invalid values and noise from distant sparse regions to propagate into the decoder. Second, a single convolutional or sequence-modeling architecture often struggles to preserve both local high-frequency geometric details and global long-range dependencies, resulting in over-smoothed reconstructions. Third, smooth transition depths near foreground-background boundaries can produce spike artifacts when the 2D range image is back-projected into 3D. To address these issues, we propose a point cloud super-resolution method based on multi-scale spatial priors and joint local-global modeling. The design comprises a spatially gated fusion module, a multi-granularity local-global cooperative perception module, and 2D median-residual denoising. Experiments on KITTI-360 and nuScenes demonstrate effective reconstruction, with IoU scores of 0.4703 and 0.3593, respectively, supporting the feasibility of the proposed method for range-image super-resolution.
BibTeX
@misc{yang2026local,
  author = {Wang Yang and Wenyi Ge},
  title = {{Local-Global Joint Modeling for Point Cloud Super-Resolution Guided by Multi-Scale Spatial Priors}},
  year = {2026},
  eprint = {2611.02786},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.02786},
}
Figure