A Deformable Dual-Branch Visual State-Space Network for Landslide Identification with Multi-Scale Recognition and Irregular Boundary Enhancement

Bowen Du, Wanchao Huang, Leilei Sun, Bin Tong, Yueping YinRemote 2026 · DOI

TL;DR

This paper introduces DFmamba, a novel dual-branch network that combines convolutional and state-space models to accurately map landslides, even with complex boundaries and varying scales. It achieves state-of-the-art results while maintaining computational efficiency, making it promising for real-time disaster response.

What Problem Does This Paper Address?

Landslides are a major geological hazard, and accurately identifying and mapping them is crucial for disaster prevention and emergency response. Existing deep learning methods struggle with several challenges:

  • Scale Variation: Landslide identification needs to handle both massive, sprawling slides and small, subtle ones within the same image.
  • Irregular Boundaries: Landslide edges are often jagged, tortuous, and fragmented, making precise delineation difficult for models with fixed receptive fields.
  • Loss of Detail: Fine features like fissures or small collapse edges, important for identifying smaller slides and transitional zones, can be lost during multi-scale processing.
  • Computational Constraints: High-resolution imagery requires models that are efficient enough for practical deployment, especially in time-sensitive emergency situations.

Current approaches, whether CNN-based or Transformer-based, often fall short in balancing these competing demands, leading to issues like fragmented masks, missed detections, and inaccurate boundaries.

Methods

DFmamba tackles these challenges with a novel dual-branch architecture:

  • Dual-Branch Encoder:
    • CNN Branch (ResNet-50): Captures local texture and boundary information.
  • Visual State-Space Model (VSSM) Branch: Leverages Mamba-like selective state-space models to capture long-range dependencies and global context efficiently. This branch uses a four-directional SSM to propagate information across the entire feature map, mitigating issues from tiled processing.
  • Cross-Scale Fusion (CSF): Explicitly aligns and fuses features from the CNN and VSSM branches at multiple resolutions. This ensures that local details and global context are effectively integrated.
  • Deformable Residual Block (DRB): Introduced in the decoder, DRBs use learnable offsets to adaptively sample features, allowing for precise geometric modeling of irregular landslide boundaries. This is a key innovation for handling jagged and tortuous shapes.
  • Shallow High-Frequency Injection (MFP): A mechanism to preserve fine, low-level details during multi-scale fusion and upsampling, crucial for detecting small landslides and transitional zones.

The overall architecture aims for a balance between capturing fine local details and understanding global context, all while being computationally efficient.

Datasets

The study utilizes the CAS Landslide Dataset, a large-scale, multi-sensor benchmark for landslide recognition. This dataset includes RGB remote-sensing images from UAVs and satellites, with pixel-level annotations.

  • In-domain experiments: Used subsets from Hokkaido Iburi-Tobu (SAT), Moxi town (UAV), and Moxitaidi (UAV).
  • Cross-domain experiments: Evaluated on the Jiuzhai Valley (UAV) and Bijie (SAT) datasets, which differ in geomorphology, texture, and imaging conditions from the training data.

Key Insights and Ideas

  • State-Space Models for Global Context: The paper demonstrates that SSMs, like Mamba, can efficiently capture long-range dependencies in images, offering a computationally lighter alternative to Transformers for global context modeling in segmentation.
  • Deformable Convolutions for Boundary Precision: The integration of deformable convolutions (DRB) is shown to be highly effective in adapting to and accurately delineating the irregular and complex boundaries of landslides, a persistent challenge in the field.
  • Synergy of Local and Global Information: The dual-branch approach, coupled with CSF, highlights the importance of effectively fusing local texture/boundary cues with global semantic context for robust landslide segmentation.
  • Efficiency Matters: DFmamba achieves strong performance without excessive computational cost, making it practical for real-world applications where speed and resource limitations are critical.

Key Results

  • State-of-the-Art Accuracy: DFmamba achieved the best performance on the CAS Landslide Dataset with an F1-score of 0.9351 and an IoU of 0.8781, outperforming strong baselines like RS3Mamba.
  • Superior Boundary Delineation: DFmamba significantly improved the Boundary F1-score to 0.6854 (compared to 0.6032 for RS3Mamba), indicating much better accuracy in tracing landslide edges.
  • Robustness Across Scenarios: The model demonstrated stable performance across various challenging scenarios, including complex shapes, small landslides, and dense instances.
  • Favorable Efficiency: DFmamba achieved a latency of 22.58 ms/image and used 0.61 GB of peak memory on a Tesla T4 GPU, proving to be efficient and deployable.
  • Cross-Domain Transferability: The model showed strong generalization capabilities, maintaining leading performance on unseen datasets with different characteristics.

Limitations and Future Work

The authors acknowledge several limitations and suggest future directions:

  • Spatial Correlation in Splits: The current evaluation primarily uses same-source splits, which might lead to optimistic estimates compared to truly independent cross-region deployments.
  • Hardware and Workflow Profiling: Further profiling on diverse hardware and large-area mosaicking workflows would strengthen the deployability narrative.
  • Stabilizing Deformable Offsets: While DRB improves accuracy, future work could focus on stabilizing deformable offsets, especially in dense or complex-texture scenes, to enhance reproducibility.
  • Broader Validation: Future studies should include more extensive cross-region and cross-sensor validation.
  • Multi-Modal Integration: Incorporating additional data modalities like DEM/SAR could further improve performance and reduce reliance on appearance cues.
  • Optimized Inference Pipelines: Exploring overlap-blend strategies and memory-aware batching could enhance large-area mapping throughput.

Summary updated

Abstract

In recent years, rapid and reliable interpretation for emergency response to landslides and other geological hazards has become increasingly important. This paper presents DFmamba, an improved deformable dual-branch visual state-space network, to address engineering challenges such as missed large landslide bodies, boundary shifts, and loss of small-scale details. DFmamba mitigates the limited effective receptive field and window-partition constraints that often prevent existing methods from balancing large-area semantic consistency, multi-scale detection, precise boundary delineation, and computational efficiency. It employs a parallel encoder with a convolutional branch and a Visual State-Space Model (VSSM) branch to jointly capture local textures and global context. In the decoder, deformable residual blocks (DRB) enhance geometric modeling of irregular boundaries, while multi-scale feature alignment and a shallow high-frequency injection (MFP) mechanism strengthen boundary responses and preserve fine details. Experiments on the public CAS dataset against representative CNN-, Transformer-, and SSM-based baselines show that DFmamba achieves improved Precision, Recall, F1-score, and IoU, with stable performance across multi-scale scenarios, demonstrating strong robustness for landslide segmentation.
BibTeX
@inproceedings{du2026deformable,
  author = {Bowen Du and Wanchao Huang and Leilei Sun and Bin Tong and Yueping Yin},
  title = {{A Deformable Dual-Branch Visual State-Space Network for Landslide Identification with Multi-Scale Recognition and Irregular Boundary Enhancement}},
  booktitle = {Remote},
  year = {2026},
  doi = {10.3390/rs18050707},
}
Figure