Local Similarity Siamese Network for Urban Land Change Detection on Remote Sensing Images

Haeyun Lee, Kyungsu Lee, Jun Hee Kim, Younghwan Na, Juhum Park, Jihwan P. Choi, Jae Youn Hwang

Abstract

Urban change detection in remote sensing is frequently hindered by environmental noise such as shifting shadows, varying lighting conditions, and parallax errors. Traditional pixel-wise comparison methods often fail to capture the structural and semantic context necessary for accurate detection in dense urban environments. This paper introduces the Local Similarity Siamese Network (LSS-Net), which addresses these challenges through a multi-level attention mechanism and a specialized content loss function. By leveraging cosine similarity across feature maps and perceptual loss, LSS-Net significantly improves detection accuracy, achieving state-of-the-art results on major benchmarks including a newly introduced high-resolution Urban Change Detection (UCD) dataset.

Introduction

Detecting land-use changes in urban landscapes using satellite or aerial imagery is a complex task. Standard convolutional neural network (CNN) models often rely on simple feature subtraction or pixel-level loss functions like Binary Cross-Entropy. These approaches treat pixels as isolated units, making them highly sensitive to non-semantic changes—such as a building's shadow moving throughout the day. To accurately distinguish between real construction or demolition and environmental noise, models must understand the broader structural and semantic relationships within a scene.

Methodology

LSS-Net is built upon three primary architectural innovations designed to enhance structural understanding:

  1. Siamese Architecture with SE-ResNet-50: The network employs two weight-sharing branches to extract features from temporal image pairs ("before" and "after"). Squeeze-and-Excitation (SE) blocks are integrated to prioritize the most informative feature channels.
  2. Local Similarity Attention Module (LSAM): Moving beyond simple subtraction, the LSAM calculates the cosine similarity between feature maps at multiple levels. This generates an attention map that highlights structural changes while remaining robust to lighting variations.
  3. Change Attention map-based Content (CAC) Loss: Inspired by perceptual loss in image synthesis, CAC loss uses a pre-trained VGG-16 network to compare the predicted change areas against the ground truth. This ensures that the detected changes are contextually and structurally consistent with real-world urban features.
The overall architecture of LSS-Net, featuring Siamese SE-ResNet-50 branches and multi-level Local Similarity Attention Modules.

Key Insights: Similarity over Subtraction

A core finding of this research is that cosine similarity is a far more robust metric for change detection than traditional feature subtraction or concatenation. While subtraction is sensitive to absolute pixel value changes (like those caused by shadows), cosine similarity focuses on the relationship between feature vectors, effectively capturing changes in the underlying scene structure.

Comparison of different feature fusion methods against ground truth, demonstrating the superior clarity and accuracy of Cosine Similarity.

Furthermore, the multi-level fusion approach allows the model to use low-level features (edges and shapes) to refine the boundaries of detected changes, while high-level semantic features confirm the change's location and validity.

Experimental Results

The researchers evaluated LSS-Net on three benchmarks, including the newly introduced UCD (Urban Change Detection) Dataset, which features high-resolution (50 cm/px) imagery of dense, complex urban areas. LSS-Net achieved state-of-the-art (SOTA) performance across all metrics:

  • CDD (Change Detection Dataset): F1 score of 0.9630.
  • WHU Building Dataset: F1 score of 0.9377.
  • UCD Dataset: F1 score of 0.7751.

On the challenging UCD dataset, LSS-Net improved the F1 score by nearly 5% over previous leading models. Qualitative analysis showed that the model produced much cleaner boundaries for new buildings and significantly fewer false positives in shadowed regions compared to baseline methods.

Conclusion and Future Work

LSS-Net demonstrates that incorporating structural similarity and perceptual loss is vital for robust urban change detection. While the model excels at binary change detection, future research will focus on multiclass change detection—identifying the specific nature of the change (e.g., from vegetation to building). Additionally, the authors aim to improve recall in extremely cluttered environments and optimize the computational overhead associated with multi-level attention and auxiliary loss networks.

Summary updated

Abstract

Change detection is an important task in the field of remote sensing. Various change detection methods based on convolutional neural networks (CNNs) have recently been proposed for remote sensing using satellite or aerial images. However, existing methods allow only the partial use of content information in images during change detection because they adopt simple feature similarity measurements or pixel-level loss functions to construct their network architectures. Therefore, when these methods are applied to complex urban areas, their performance in terms of change detection tends to be limited. In this article, a novel CNN-based change detection approach, referred to as a local similarity Siamese network (LSS-Net), with a cosine similarity measurement, was proposed for better urban land change detection in remote sensing images. To use content information on two sequential images, a new change attention map-based content loss function was developed in this study. In addition, to enhance the performance of the LSS-Net in terms of change detection, a suitable feature similarity measurement method, incorporated into a local similarity attention module, was determined through systemic experiments. To verify the change detection performance of the LSS-Net, it was compared with other state-of-the-art methods. The experimental results show that the proposed method outperforms the state-of-the-art methods in terms of the F1 score (0.9630, 0.9377, and 0.7751) and kappa (0.9581, 0.9351, and 0.7646) on the three test datasets, thus suggesting its potential for various remote sensing applications.
BibTeX
@article{lee2021local,
  author = {Haeyun Lee and Kyungsu Lee and Jun Hee Kim and Younghwan Na and Juhum Park and Jihwan P. Choi and Jae Youn Hwang},
  title = {{Local Similarity Siamese Network for Urban Land Change Detection on Remote Sensing Images}},
  journal = {IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens.},
  year = {2021},
  doi = {10.1109/jstars.2021.3069242},
}
Figure