STNet: Spatial and Temporal feature fusion network for change detection in remote sensing images

Xiaowen Ma, Jiawei Yang, Tingfeng Hong, Mengting Ma, Ziyan Zhao, Tian Feng, Wei Zhang

Abstract

Remote Sensing Change Detection (RSCD) is often hindered by environmental noise and the difficulty of maintaining precise object boundaries. This paper introduces STNet, a Siamese architecture that integrates a Temporal Feature Fusion (TFF) module and a Spatial Feature Fusion (SFF) module. STNet utilizes a cross-temporal gating mechanism to suppress irrelevant spectral variations and a cross-scale attention mechanism to refine spatial details. Experimental results on WHU, LEVIR-CD, and CLCD datasets demonstrate that STNet achieves state-of-the-art performance with significantly lower computational complexity (9.61 GFLOPs) compared to existing models.

Introduction

Change detection in bi-temporal satellite imagery is critical for monitoring urban expansion and land-use changes. However, two primary challenges persist: (1) "changes of non-interest," such as seasonal vegetation shifts, shadows, and lighting differences, which introduce spectral noise; and (2) the "boundary problem," where the sparse nature of changed objects makes it difficult to recover sharp edges after multiple downsampling layers. Traditional methods using simple feature subtraction or concatenation often fail to distinguish between semantic land-use changes and environmental variations.

Methodology

STNet employs a Siamese ResNet-18 backbone to extract multi-scale features from bi-temporal images $T$ and $T'$. The architecture is defined by two core fusion components:

Temporal Feature Fusion (TFF)

The TFF module addresses environmental noise through a cross-temporal gating mechanism. Instead of simple subtraction, it generates a coarse change map to weight the original features. This "gating" process prioritizes regions with significant semantic change while suppressing areas affected by seasonal or lighting variations.

Spatial Feature Fusion (SFF)

To preserve spatial precision, the SFF module implements a cross-scale attention mechanism. It leverages high-level semantic context from deeper layers to guide the fusion of low-level spatial features from shallower layers. This top-down guidance ensures that the model maintains sharp boundaries for small or sparse objects, such as building footprints.

The overall architecture of STNet, illustrating the integration of ResNet blocks with TFF and SFF modules.

The final stage uses a lightweight decoder with a Channel Attention Module (CAM) and a hybrid loss function (Focal Loss + Dice Loss) to address class imbalance.

Experiments and Results

STNet was evaluated on three benchmark datasets: WHU Building, LEVIR-CD, and CropLand Change Detection (CLCD).

Quantitative Performance

On the LEVIR-CD dataset, STNet achieved an F1-score of 90.52% and an IoU of 82.09%. Notably, the model is highly efficient, requiring only 9.61 GFLOPs. This is a substantial reduction compared to other high-performing models like SNUNet (54.88 GFLOPs) and IFNet (82.26 GFLOPs), making it suitable for large-scale deployment.

Qualitative Analysis

Visual comparisons indicate that STNet produces cleaner change maps with fewer false positives in regions with shadows or vegetation changes. The SFF module effectively maintains the geometric integrity of building corners and edges, outperforming models like SNUNet and ChangeFormer in boundary precision.

Qualitative comparison of STNet against state-of-the-art methods across different datasets.

Conclusion

STNet provides a robust and efficient solution for remote sensing change detection. By combining cross-temporal gating and cross-scale attention, the model effectively filters environmental noise and recovers fine-grained spatial details. Future research will explore the model's applicability to heterogeneous data sources and its performance in semi-supervised learning environments.

Summary updated

Abstract

As an important task in remote sensing image analysis, remote sensing change detection (RSCD) aims to identify changes of interest in a region from spatially co-registered multi-temporal remote sensing images, so as to monitor the local development. Existing RSCD methods usually formulate RSCD as a binary classification task, representing changes of interest by merely feature concatenation or feature subtraction and recovering the spatial details via densely connected change representations, whose performances need further improvement. In this paper, we propose STNet, a RSCD network based on spatial and temporal feature fusions. Specifically, we design a temporal feature fusion (TFF) module to combine bitemporal features using a cross-temporal gating mechanism for emphasizing changes of interest; a spatial feature fusion module is deployed to capture fine-grained information using a cross-scale attention mechanism for recovering the spatial details of change representations. Experimental results on three benchmark datasets for RSCD demonstrate that the proposed method achieves the state-of-the-art performance. Code is available at https://github.com/xwmaxwma/rschange.
BibTeX
@inproceedings{ma2023stnet,
  author = {Xiaowen Ma and Jiawei Yang and Tingfeng Hong and Mengting Ma and Ziyan Zhao and Tian Feng and Wei Zhang},
  title = {{STNet: Spatial and Temporal feature fusion network for change detection in remote sensing images}},
  booktitle = {ICME},
  year = {2023},
  url = {https://openreview.net/forum?id=5Fc0HEaUg3},
}
Figure