GDSR: Global-Detail Integration Through Dual-Branch Network With Wavelet Losses for Remote Sensing Image Super-Resolution

Qiwei Zhu, Kai Li, Guojing Zhang, Xiaoying Wang, Jianqiang Huang, Xilai Li

TL;DR

This paper introduces GDSR, a novel dual-branch network for remote sensing image super-resolution that effectively integrates global context and local details. By leveraging the efficient long-range modeling of RWKV and the fine-grained feature extraction of CNNs, GDSR achieves state-of-the-art performance with significantly reduced computational cost and faster inference speeds.

What Problem Does This Paper Address?

Remote sensing images (RSIs) are crucial for various applications, but their resolution is often limited by sensor capabilities and transmission bandwidth. Super-resolution (SR) aims to enhance these images, but existing deep learning methods often struggle to balance the capture of global contextual information with the precise reconstruction of local details. Many methods either focus on one aspect, leading to incomplete representations, or incur prohibitive computational costs for large-scale RSIs. Furthermore, the inherent imbalance in spatial frequency composition between low-resolution (LR) and high-resolution (HR) RSIs, where LR images are dominated by low-frequency components and critical high-frequency features are attenuated, presents a significant challenge for reconstruction.

Methods

GDSR employs a novel dual-branch architecture to address the global-local dependency challenge.

  • Global Extraction Branch (RGEG): This branch utilizes the Receptance Weighted Key Value (RWKV) architecture. RWKV is a recent development that offers linear complexity for capturing long-range dependencies, outperforming traditional Transformers and Mamba-based models in this regard. The RGEG branch uses multiple Residual RWKV Blocks (R-RWKVBs) that incorporate spatial and channel mix modules to model global context.
  • Details Extraction Branch (RDEG): This branch employs Convolutional Neural Networks (CNNs), specifically structured as a sequence of Residual Convolution Blocks (RCBs). CNNs are well-suited for extracting local, fine-grained features.
  • Global-Detail Reconstruction Module (GDRM): This module acts as an intermediary, fusing the features from the RGEG and RDEG branches. It uses a Permuted Spatial Attention Module (PSAM) to harmonize and align features from both branches, enabling synergistic integration.
  • Dual-Group Multi-Scale Wavelet Loss: To further enhance reconstruction fidelity, a novel wavelet-domain loss is introduced. This loss leverages a dual-group subband strategy and cross-resolution frequency alignment to enforce consistency across different frequency components and scales, improving the recovery of high-frequency details.

Datasets

The proposed GDSR model was trained and evaluated on the following datasets:

  • AID (Aerial Image Dataset): A large-scale dataset with 30 land-use categories.
  • UCMerced: A dataset comprising 21 geospatial scene categories.
  • RSSRD-QH: A custom dataset collected from representative watershed units in the Sanjiangyuan region and Qinghai Lake area, featuring high spatial resolution imagery.

Two degradation models were used: bicubic downsampling and a comprehensive degradation model (CDM) that simulates realistic noise and blur found in RSIs.

Key Insights and Ideas

  • Synergy of Global and Local: The core insight is that effectively modeling both global context (long-range dependencies) and local details (fine-grained textures) is crucial for high-quality RSI super-resolution. GDSR demonstrates that a dual-branch approach, where each branch specializes in one aspect, is more effective than single-branch methods.
  • RWKV for Long-Range Dependencies: The paper highlights RWKV's potential for efficient and effective modeling of long-range dependencies in images, offering a compelling alternative to Transformers and Mamba for tasks requiring broad contextual understanding.
  • Wavelet Loss for Frequency Fidelity: The novel wavelet loss function provides a powerful mechanism to guide the SR model towards better reconstruction of high-frequency details, which are often lost in traditional SR methods. The multi-scale and dual-group approach further refines this by considering inter-scale relationships.
  • Computational Efficiency is Key: The authors emphasize that for large-scale RSIs, computational cost is a major bottleneck. GDSR's design, particularly the use of RWKV, significantly reduces parameters and FLOPs while improving inference speed, making it more practical for real-world applications.

Key Results

  • State-of-the-Art Performance: GDSR outperforms leading Transformer-based methods like HAT by an average of 0.09 dB in PSNR on benchmarks.
  • Significant Efficiency Gains: GDSR uses only 63% of the parameters and 51% of the FLOPs compared to HAT, achieving an inference speed 3.2 times faster.
  • Robustness and Generalization: The model demonstrates strong performance across diverse datasets and degradation scenarios, including challenging CDM-synthesized data and real-world RSIs. It also shows good generalization capabilities to unseen categories.
  • Effective Feature Fusion: Ablation studies confirm the effectiveness of the GDRM in integrating global and local features, leading to improved PSNR, SSIM, and LPIPS scores.
  • Wavelet Loss Benefits: The proposed wavelet loss significantly improves reconstruction quality, especially for high-frequency details, as evidenced by visual comparisons.

Limitations and Future Work

  • Parameter Count in Detail Extraction: The authors acknowledge that the stacked residual convolutions in the RDEG branch contribute to a high parameter count, limiting model efficiency. Future work will explore more efficient architectures for detail extraction.
  • RGB Data Limitation: The current validation is limited to RGB RSIs. Future work aims to extend the method to hyperspectral SR, addressing the challenge of balancing spatial enhancement with spectral fidelity.
  • Temporal and Cross-Sensor Applications: The paper suggests investigating the model's applicability to multi-temporal or cross-sensor RSIs, which would involve addressing challenges like temporal consistency and domain adaptation.
  • Perceptual vs. Fidelity Trade-off: While the wavelet loss improves fidelity, it can sometimes lead to higher LPIPS (perceptual) scores compared to pure L1 loss. The authors suggest that their dual-group multi-scale approach strikes a good balance.

Summary updated

Abstract

In recent years, deep neural networks, including convolutional neural networks (CNNs), Transformers, and State-Space Models, have achieved significant progress in remote sensing image (RSI) super-resolution (SR). However, existing SR methods typically overlook the complementary relationship between global and local dependencies. These methods either focus on capturing local information or prioritize global information, which results in models that are unable to effectively capture both global and local features simultaneously. Moreover, their computational cost becomes prohibitive when applied to large-scale RSIs. To address these challenges, we introduce the novel application of receptance weighted key value (RWKV) to RSI-SR, which captures long-range dependencies with linear complexity. To simultaneously model global and local features, we propose the global-detail dual-branch structure, Global-Detail SR (GDSR), which performs SR by paralleling RWKV and convolutional operations to handle large-scale RSIs. Furthermore, we introduce the global-detail reconstruction module (GDRM) as an intermediary between the two branches to bridge their complementary roles. In addition, we propose the dual-group multiscale wavelet loss, a wavelet-domain constraint mechanism via dual-group subband strategy and cross-resolution frequency alignment for enhanced reconstruction fidelity in RSI-SR. Extensive experiments under two degradation methods on several benchmarks, including AID, UCMerced, and RSSRD-QH, demonstrate that GSDR outperforms the state-of-the-art Transformer-based method HAT by an average of 0.09 dB in the peak signal-to-noise ratio (PSNR), while using only 63% of its parameters and 51% of its FLOPs, achieving an inference speed 3.2 times faster.
BibTeX
@article{zhu2025gdsr,
  author = {Qiwei Zhu and Kai Li and Guojing Zhang and Xiaoying Wang and Jianqiang Huang and Xilai Li},
  title = {{GDSR: Global-Detail Integration Through Dual-Branch Network With Wavelet Losses for Remote Sensing Image Super-Resolution}},
  journal = {IEEE Trans. Geosci. Remote. Sens.},
  year = {2025},
  url = {https://openreview.net/forum?id=G9qZw0gZTE},
}
Figure