SpatialSR: Spatial Resolution-Centric Pipeline for Arbitrary-Scale Remote Sensing Super-Resolution

Yan Zhang, Runfeng Luo, Liangke Gao, Lin Yuan, Bin Xiao, Xinbo GaoarXiv 2026 · arXiv

TL;DR

SpatialSR shifts the paradigm of remote sensing super-resolution from relative scale factors to absolute physical spatial resolution (SRe). By combining a resolution estimation module with a novel Trajectory Consistency (TC) loss, the pipeline achieves generative-quality textures in a single inference step, significantly improving performance for downstream tasks like semantic segmentation and object classification.

What Problem Does This Paper Address?

In remote sensing, an image isn't just a grid of pixels; it represents a specific physical area (e.g., 0.1 meters per pixel). Traditional Arbitrary-Scale Super-Resolution (ASSR) methods typically focus on the relative scale factor (e.g., upscaling an image by 4x).

However, the authors argue that a 4x upscale from 4.0m/px to 1.0m/px requires a fundamentally different texture distribution than a 4x upscale from 0.4m/px to 0.1m/px. As shown in Figure 1, images at different absolute resolutions exhibit distinct high-frequency energy distributions. Ignoring this "absolute spatial resolution" prior leads to texture ambiguity and structural distortions, which ultimately hampers the performance of downstream AI models that rely on these images for tasks like land-cover mapping.

Illustration of how texture distributions and downstream performance vary by absolute spatial resolution (SRe) even at the same 4x scale factor.

Methods

SpatialSR is an encoder-decoder framework comprising three innovative components:

  1. Spatial Resolution Estimation Module (SREM): Since metadata (like flight altitude) is often missing, SREM uses a hybrid sampling strategy (combining random, Laplacian, and Haar wavelet operators) to estimate the input image's SRe. This allows the system to dynamically calculate the exact scaling factor needed to reach a specific target resolution (e.g., 0.1m/px).
  2. Resolution-aware Style Consistency Module (RSCM): The authors fine-tuned a Stable Diffusion model to learn resolution-specific textures. During inference, "style codes" corresponding to the target resolution are extracted and injected into the decoder using a FiLM-like (Feature Linear Modulation) mechanism. This ensures the reconstructed textures are physically consistent with the target resolution.
  3. Trajectory Consistency (TC) Loss: Diffusion models produce amazing textures but are notoriously slow due to their iterative sampling process. The TC loss reformulates the diffusion process into a trajectory alignment constraint. By minimizing the distance between the denoising trajectories of the super-resolved image and the ground truth, the model learns to generate high-fidelity textures in a single feed-forward step.
Figure 2: Overview of the proposed SpatialSR pipeline. Our pipeline consists of three core components. (a) The SREM estimates the source SRe from the LR image and then computes the scale factor together with the target SRe (Section 3.2). (b) The RSCM synthesizes the final image under the modulation of a style embedding derived from the SRe-to-img model (Section 3.3). (c) Finally, the TC loss refines texture details by aligning the diffusion trajectories (Section 3.4).

Datasets

The model was evaluated on several standard benchmarks and a new dataset:

  • Semantic Segmentation: ISPRS-Vaihingen, LoveDA-val, and UAVid.
  • Image Classification: UCMD and WHU-RS19.
  • MSRUAV (New): The Multi-Spatial Resolution Unmanned Aerial Vehicle dataset, containing over 7,000 images (UAV and Google Earth) covering resolutions from 0.1 to 2.0 m/pixel.

Key Insights and Ideas

  • Resolution as a Physical Prior: The core "aha" moment is treating spatial resolution as a physical attribute rather than just a resizing parameter. This aligns the super-resolution process with the way downstream models "see" the world.
  • Generative Power, Real-time Speed: By wrapping the diffusion process into the TC loss (Figure 4), the authors successfully distilled the complex distribution-modeling capability of generative models into a standard, fast architecture.
  • Downstream-First Design: The paper highlights a frequent mismatch: SR methods that score high on pixel-fidelity metrics (like PSNR) often fail in downstream tasks because they produce "over-smoothed" results. SpatialSR prioritizes semantically meaningful textures.
Visualizing the TC loss, which aligns the denoising trajectories of the SR and GT images to encourage realistic texture generation.

Key Results

SpatialSR achieves state-of-the-art (SOTA) results across the board:

  • Downstream Accuracy: On the Vaihingen dataset at 10x scale, SpatialSR outperformed the previous best method (ResShift) by 4.1% in mIoU (mean Intersection over Union).
  • Perceptual Quality: It significantly reduced perceptual error (LPIPS) compared to other generative and implicit neural representation (INR) methods.
  • Efficiency: Despite its generative capabilities, SpatialSR maintains an inference time of just 0.0074 seconds for a 128 to 512 upscale on an RTX 4090. This is orders of magnitude faster than iterative diffusion methods like IDM (~35 seconds).

Limitations and Future Work

The authors acknowledge that SpatialSR currently struggles with target resolutions outside its predefined training range (0.1 to 2.0 m/px). Additionally, cross-sensor scenarios (e.g., training on UAV data but testing on satellite data) can lead to performance drops due to distribution shifts.

Future research will focus on modeling how image details evolve across a truly continuous spectrum of spatial resolutions to improve generalization across different sensors and altitudes.

Summary updated

Abstract

Although remote sensing image arbitrary-scale super-resolution (RSI-ASSR) methods support reconstruction at arbitrary or continuous scales, they predominantly condition on the relative scale factor and have not sufficiently investigated the absolute spatial resolution itself as a reconstruction prior, thereby disregarding the inherent spatial context of objects, which frequently leads to spatial-related distortions and compromised performance in downstream remote sensing applications. To address these challenges, we introduce SpatialSR, a SRe-centric arbitrary-scale RSISR method that leverages the spatial resolution (SRe) of remote sensing images (RSI) as an essential prior for super-resolution reconstruction. Distinct from existing SR methods, SpatialSR aims to restore high-resolution remote sensing images with a target SRe (typically set to 0.1m/pixel to align with the metadata of commonly used downstream task datasets). Specifically, we design a Spatial Resolution Estimation Module (SREM) to estimate the SRe of low-resolution (LR) images, thereby dynamically determining the required arbitrary scaling factor. Next, we employ a pretrained SRe-to-image diffusion model to extract SRe-specified texture-style codes, which are further incorporated into a carefully designed Resolution-aware Style Consistency Module (RSCM) to constrain the SRe-aware texture consistency of reconstructed images. Furthermore, to overcome the high computational expense inherent in diffusion-based SR methods, we wrap the iterative diffusion process as a Trajectory Consistency (TC) loss, which enables comparable reconstructed texture quality of the generative model in SpatialSR within a single step. Extensive experiments demonstrate that the proposed SpatialSR achieves state-of-the-art (SOTA) performance on commonly used RSISR and downstream (image classification and segmentation tasks) datasets.
BibTeX
@misc{zhang2026spatialsr,
  author = {Yan Zhang and Runfeng Luo and Liangke Gao and Lin Yuan and Bin Xiao and Xinbo Gao},
  title = {{SpatialSR: Spatial Resolution-Centric Pipeline for Arbitrary-Scale Remote Sensing Super-Resolution}},
  year = {2026},
  eprint = {2611.13046},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.13046},
}
Figure