RDNet: Region Proportion-Aware Dynamic Adaptive Salient Object Detection Network in Optical Remote Sensing Images

Bin Wan, Runmin Cong, Xiaofei Zhou, Hao Fang, Yaoqi Sun, Sam Kwong

TL;DR

RDNet is a novel salient object detection (SOD) framework specifically designed for the extreme scale variations found in optical remote sensing images. By combining a SwinTransformer backbone with a "region proportion-aware" strategy, the network dynamically adjusts its convolution kernels and leverages wavelet-based frequency matching to achieve state-of-the-art accuracy with high computational efficiency.

What Problem Does This Paper Address?

Salient Object Detection (SOD) aims to identify the most visually prominent objects in an image. In Optical Remote Sensing Imagery (ORSI), this is notoriously difficult. Unlike natural scenes where objects are usually centered and somewhat uniform in scale, remote sensing images feature:

  1. Extreme Scale Variation: A single dataset might contain a tiny car (a few pixels) and a massive stadium (covering half the image).
  2. Fixed Kernel Limitations: Standard CNNs use fixed-size convolution kernels. Small kernels miss the "big picture" of large objects, while large kernels wash out the details of tiny objects with background noise.
  3. Computational Bottlenecks: While self-attention mechanisms (like Transformers) help capture global context, applying them to high-resolution features is computationally expensive and often merges high- and low-frequency information indiscriminately.

Methods

The authors introduce RDNet, which moves away from traditional CNN backbones in favor of a SwinTransformer to better capture long-range dependencies. The core innovation lies in three specialized modules:

  • Region Proportion-aware Localization (RPL) Module: This module uses cross-attention to refine object locations. Crucially, it includes a Proportion Guidance (PG) block that estimates what percentage of the image the salient object occupies.
  • Dynamic Adaptive Detail-aware (DAD) Module: This is the "brain" of the scaling strategy. Based on the proportion estimated by the PG block, the DAD module dynamically selects different combinations of convolution kernels (ranging from $3 \times 3$ to $9 \times 9$). If an object is large, it uses larger kernels to capture the whole structure; if small, it sticks to tighter kernels to preserve edges.
  • Frequency-matching Context Enhancement (FCE) Module: To handle middle-layer features efficiently, the FCE uses Discrete Wavelet Transforms (DWT) to decompose features into different frequency components. It performs "wavelet interactions" to exchange information between layers, which reduces computational complexity by a factor of four compared to standard self-attention while maintaining high-quality feature fusion.

Datasets

The model was evaluated on three major public benchmarks for remote sensing SOD:

  • ORSSD: 800 images (the first major dataset for this task).
  • EORSSD: 2,000 images (an expanded version of ORSSD with more challenging scenes).
  • ORSI-4199: 4,199 images (the largest and most diverse dataset currently available).

Key Insights and Ideas

  • "Size-Aware" Processing: The most significant "aha moment" is that the network shouldn't treat every image the same. By explicitly predicting the proportion of the object first, the network can reconfigure its own architecture (kernel sizes) on the fly to match the target.
  • Wavelets for Efficiency: Instead of performing heavy matrix multiplications on full-resolution features, the FCE module's use of wavelets allows the network to "talk" across different layers in the frequency domain. This filters out noise and focuses on the structural context that matters.
  • Backbone Shift: The paper confirms that the hierarchical nature of the SwinTransformer is superior to older backbones like VGG or ResNet for remote sensing, as it naturally handles the "global-to-local" requirements of aerial imagery.

Key Results

RDNet was compared against 21 state-of-the-art methods. It consistently ranked first across all three datasets:

  • EORSSD: Achieved a Mean Absolute Error (MAE) of 0.0049 and an F-measure of 0.8563, representing a significant improvement over previous leaders like HFCNet and GeleNet.
  • ORSI-4199: On the largest dataset, it improved the F-measure by 10.7% compared to the Transformer-based VST model.
  • Efficiency: Despite the complex modules, RDNet maintains a relatively small model size and runs at 13 FPS on a single RTX 3090, making it viable for practical applications.

Limitations and Future Work

The authors identify specific failure cases where the model still struggles:

  • Extremely Fine Details: When objects are exceptionally thin or small (like thin wires or tiny debris), the network can still lose track of them.
  • Texture Confusion: If the background shares a very similar texture and color with the target (e.g., a paved runway surrounding a plane), the model sometimes over-segments the region, including the "non-salient" background as part of the object.

Future work will likely focus on even higher-resolution processing and improving the discrimination between objects and highly similar background clutter.

Summary updated

Abstract

Salient object detection (SOD) in remote sensing images faces significant challenges due to large variations in object sizes, the computational cost of self-attention mechanisms, and the limitations of CNN-based extractors in capturing global context and long-range dependencies. Existing methods that rely on fixed convolution kernels often struggle to adapt to diverse object scales, leading to detail loss or irrelevant feature aggregation. To address these issues, this work aims to enhance robustness to scale variations and achieve precise object localization. We propose the Region Proportion-Aware Dynamic Adaptive Salient Object Detection Network (RDNet), which replaces the CNN backbone with the SwinTransformer for global context modeling and introduces three key modules: (1) the Dynamic Adaptive Detail-aware (DAD) module, which applies varied convolution kernels guided by object region proportions; (2) the Frequency-matching Context Enhancement (FCE) module, which enriches contextual information through wavelet interactions and attention; and (3) the Region Proportion-aware Localization (RPL) module, which employs cross-attention to highlight semantic details and integrates a Proportion Guidance (PG) block to assist the DAD module. By combining these modules, RDNet achieves robustness against scale variations and accurate localization, delivering superior detection performance compared with state-of-the-art methods.
BibTeX
@article{wan2025rdnet,
  author = {Bin Wan and Runmin Cong and Xiaofei Zhou and Hao Fang and Yaoqi Sun and Sam Kwong},
  title = {{RDNet: Region Proportion-Aware Dynamic Adaptive Salient Object Detection Network in Optical Remote Sensing Images}},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  year = {2025},
}
Figure