DA-Mamba: Learning Domain-Aware State Space Model for Global-Local Alignment in Domain Adaptive Object Detection

Haochen Li, Rui Zhang, Hantao Yao, Xin Zhang, Yifan Hao, Shaohui Peng, Yongwei Zhao, Ling LiarXiv 2026 · arXiv

TL;DR

DA-Mamba introduces a highly efficient hybrid CNN-State Space Model (SSM) architecture designed for Domain Adaptive Object Detection (DAOD). By integrating two novel modules—Image-Aware SSM and Object-Aware SSM—it achieves comprehensive global and local feature alignment across domains with linear time complexity. This approach significantly outperforms traditional CNN and Transformer-based methods in accuracy while drastically reducing computational overhead.

What Problem Does This Paper Address?

Domain Adaptive Object Detection (DAOD) aims to transfer object detection models trained on a labeled source domain (e.g., clear daylight images) to an unlabeled target domain (e.g., foggy or stylized images). A major hurdle in DAOD is feature alignment—ensuring the model focuses on domain-invariant features.

Traditional CNN-based detectors are limited by their local receptive fields; they align features region-by-region but fail to capture global context, such as the relationships between distant objects or overall scene layouts. While Vision Transformers (ViTs) can capture these global dependencies via self-attention mechanisms, their quadratic computational complexity ($O(N^2)$) makes them too resource-intensive for practical, real-time deployment. DA-Mamba addresses this critical trade-off, providing global-local domain alignment without the heavy computational tax of Transformers.

Figure 1. (a) Existing DAOD methods focus on aligning features at image and instance-level to extract domain-invariant features. However, they only achieve local alignment due to the locality of CNN-based backbone and head, resulting in insufficient alignment across regions. (b) Our DA-Mamba utilizes SSM’s long-range perception capability to extract global domain-invariant features, introducing the Image- Aware SSM module to the backbone to supplement global domain attributes, and the Object-Aware SSM module to the detection head to model spatial and semantic dependencies between objects, achieving fine-grained alignment at image and instance-level.

Methods

The authors leverage the recent success of Mamba—a State Space Model (SSM) variant known for modeling long-range dependencies with linear time complexity ($O(N)$). They propose DA-Mamba, which inserts two domain-aware SSM modules into a standard anchor-free detector framework (YOLO-World):

  1. Image-Aware SSM (IA-SSM): Integrated into the feature extraction backbone (FPN). It utilizes a dual-pipeline design (a convolution pipeline for local features and an SSM pipeline for global context) along with a learnable image-level visual prompt to capture global visual attributes across the entire image.
  2. Object-Aware SSM (OA-SSM): Integrated into the detection head. It models spatial and semantic dependencies among instances (e.g., recognizing that a "rider" often co-occurs with a "bicycle"). To ensure stable category semantics across domains, it uses text embeddings from a pre-trained CLIP model as global semantic anchors.

Both modules use a parallel architecture that processes local and global features independently before fusing them, which keeps the model lightweight.

Figure 2. Overview of the proposed DA-Mamba. The proposed IA-SSM and OA-SSM are integrated into the FPN of the backbone and detection head, respectively, providing fine-grained image and instance-level global-local alignment.

Datasets

The model was evaluated across several mainstream DAOD benchmarks representing different types of domain shifts:

  • Cross-Weather: Cityscapes $\rightarrow$ Foggy Cityscapes
  • Cross-Field of View (FoV): Cityscapes $\rightarrow$ BDD100K
  • Cross-Style: Pascal VOC $\rightarrow$ Clipart and Pascal VOC $\rightarrow$ Comic
  • Single-Category Benchmarks: KITTI $\rightarrow$ Cityscapes and SIM10k $\rightarrow$ Cityscapes (evaluating spatial alignment on the "car" class alone)

Key Insights and Ideas

  • Standard Mamba is Domain-Agnostic: Simply swapping CNN layers for standard Mamba blocks yields poor results in DAOD because vanilla Mamba's state update strategy doesn't account for domain distribution shifts. DA-Mamba fixes this by grounding the SSM with convolutional local priors and domain-specific visual prompts.
  • Decoupling Global and Local Alignment: By utilizing a parallel dual-pipeline, the model independently optimizes for local translation invariance (via CNNs) and global context (via SSMs), leading to more robust domain-invariant representations.
  • Text Priors as Anchors: Leveraging CLIP text embeddings to generate category prototypes provides a domain-agnostic semantic baseline, helping the object-aware module accurately map instance relationships regardless of visual style changes.

Key Results

  • State-of-the-Art Accuracy: DA-Mamba achieved 58.1% mAP on the Cityscapes $\rightarrow$ Foggy Cityscapes task (a 2.2% improvement over SOTA) and 52.5% mAP on Pascal VOC $\rightarrow$ Clipart (a 3.4% improvement over SOTA).
  • High Efficiency: Compared to Transformer-based methods like DATR, DA-Mamba delivers a 4.7% higher mAP while operating at 2.62$\times$ the FPS, using only 37.1% of the inference memory, and consuming 50.2% of the FLOPs.
  • Structural Optimization: The parallel pipeline variant of the SSM modules achieved the exact same accuracy as a serial design but required only 20% of the parameters (1.732M vs. 8.610M).

Limitations and Future Work

While DA-Mamba shows excellent robustness, the authors note that it still struggles with missed detections in regions suffering from extreme visual ambiguity or heavy object occlusion.

For future work, the authors suggest:

  • Developing SSMs with native multi-scale global modeling capabilities to replace the current method of inserting blocks into an existing FPN structure.
  • Incorporating uncertainty estimation schemes to let the model dynamically balance local vs. global alignment depending on the severity of the domain shift.
  • Extending this global-local SSM alignment principle to related tasks like instance segmentation, open-vocabulary detection, and video domain adaptation.

Summary updated

Abstract

Domain Adaptive Object Detection (DAOD) aims to transfer detectors from a labeled source domain to an unlabeled target domain. Existing DAOD methods employ multi-granularity feature alignment to learn domain-invariant representations. However, the local connectivity of their CNN-based backbone and detection head restricts alignment to local regions, failing to extract global domain-invariant features. Although transformer-based DAOD methods capture global dependencies via attention mechanisms, their quadratic computational cost hinders practical deployment. To solve this, we propose DA-Mamba, a hybrid CNN-State Space Models (SSMs) architecture that combines the efficiency of CNNs with the linear-time long-range modeling capability of State Space Models (SSMs) to capture both global and local domain-invariant features. Specifically, we introduce two novel modules: Image-Aware SSM (IA-SSM) and Object-Aware SSM (OA-SSM). IA-SSM is integrated into the backbone to enhance global domain awareness, enabling image-level global and local alignment. OA-SSM is inserted into the detection head to model spatial and semantic dependencies among objects, enhancing instance-level alignment. Comprehensive experiments demonstrate that the proposed method can efficiently improve the cross-domain performance of the object detector.
BibTeX
@misc{li2026da,
  author = {Haochen Li and Rui Zhang and Hantao Yao and Xin Zhang and Yifan Hao and Shaohui Peng and Yongwei Zhao and Ling Li},
  title = {{DA-Mamba: Learning Domain-Aware State Space Model for Global-Local Alignment in Domain Adaptive Object Detection}},
  year = {2026},
  eprint = {2603.18757},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2603.18757},
}
Figure