SpotDiff: A Plug-and-Play Framework for Zero-Shot Change Detection in Remote Sensing Imagery

Anit Upadhyaya, Ata Akbari Asanjan, Chaitanya Jalluri, Subash Yeggina, Jeremy KravitzarXiv 2026 · arXiv

TL;DR

SpotDiff is a training-free, "plug-and-play" framework that achieves state-of-the-art zero-shot change detection in satellite imagery by cleverly composing three foundation models: DINOv3 for features, AnyUp for pixel-perfect resolution, and SAM 3 for object proposals. By eliminating the need for expensive pixel-level annotations, it offers a scalable way to monitor urban growth, deforestation, and disaster impact across different sensors and resolutions.

What Problem Does This Paper Address?

Change detection (CD)—the task of identifying meaningful differences between images of the same location taken at different times—is the backbone of modern Earth observation. Traditionally, this requires massive datasets of "before and after" image pairs with painstaking, pixel-level human annotations.

This supervised approach has a major scalability problem: a model trained on high-resolution aerial photos of Texas might fail miserably on medium-resolution satellite imagery of the Amazon. While "zero-shot" (training-free) methods exist, they often struggle with fine-grained details. Their features are either too coarse (patch-level) or inconsistent across different lighting and seasonal conditions, leading to "noisy" change maps that mistake a passing cloud or a change in shadows for a new building.

Methods

The authors propose SpotDiff, a modular framework that separates what changed from where to look. Instead of training a new model, they compose existing "foundation" models into a high-performance pipeline:

  1. The Similarity Module (The "What"): It uses DINOv3 to extract semantically rich features. However, Vision Transformers (ViTs) like DINO typically produce features at a coarse "patch" resolution (e.g., 16x16 pixels). To fix this, SpotDiff introduces AnyUp, a universal feature upsampler, to reconstruct these features at full pixel resolution. This ensures that the boundaries of changed objects are sharp and accurate.
  2. The RoI Proposal Module (The "Where"): It uses SAM 3 (Segment Anything Model) guided by a text prompt (like "building" or "road") to identify candidate objects in both images. To handle tiny objects in massive satellite tiles, they developed SWIMS (Sliding-Window Inference with Multiple Scales), a strategy that fuses proposals from different zoom levels.
  3. The Change Detection Module: Finally, the system compares the high-resolution features from the two dates only within the proposed object regions using simple cosine similarity. If the average similarity of an object falls below a threshold, it’s flagged as a change.
Figure 1. Overview of SpotDiff. The Similarity Module encodes both images with a frozen vision foundation model, reconstructs pixel- resolution features with a universal upsampler and computes their per-pixel cosine similarity. The Region of Interest Proposal Module segments instances of the prompted category in each image with multi-scale inference (SWIMS) and fuses them across time. The Change Detection Module marks a candidate instance as changed when its mean similarity falls below a threshold. No component is trained.

Datasets

The framework was evaluated on four major public benchmarks:

  • LEVIR-CD: 0.5m resolution aerial imagery focused on building construction and demolition.
  • WHU-CD: Another high-resolution aerial dataset for building change.
  • S2Looking: Satellite imagery with challenging "off-nadir" (side-looking) views of rural building changes.
  • SECOND: A multi-class benchmark involving six land-cover categories (trees, water, buildings, etc.).
  • Cross-resolution tests: Qualitative evaluation on PlanetScope (3m) and Sentinel-2 (10m) imagery.

Key Insights and Ideas

  • Upsampling is the "Secret Sauce": The most surprising finding was the impact of the feature upsampler. Using AnyUp instead of standard bilinear interpolation boosted the F1 score by a massive 13.8 points. This suggests that the bottleneck in zero-shot CD wasn't the quality of the features, but their spatial resolution.
  • Semantic Stability: Modern self-supervised features (DINOv3) are remarkably stable across different acquisition dates. Even without explicit training for change detection, these features "ignore" seasonal or lighting changes and focus on the actual content, making simple cosine similarity a powerful tool.
  • Composition Over Training: SpotDiff proves that you don't need a dedicated, complex architecture for change detection. By carefully "plugging" together specialized models for encoding, upsampling, and segmenting, you can outperform many task-specific unsupervised methods.
  • Prompt Engineering for Earth Observation: The authors found that prompting for "roof" worked significantly better than "building" for SAM 3, likely because satellite imagery primarily captures the tops of structures.

Key Results

SpotDiff sets a new high bar for training-free methods:

  • LEVIR-CD: Reached 82.46 F1, outperforming the previous best training-free method (OmniOVCD) by 2.06 points.
  • SECOND: Improved building change detection by 10.3 IoU and the overall six-class average by 2.2 IoU.
  • Efficiency: Despite using heavy-duty foundation models, the pipeline is relatively fast, processing a 1024x1024 image pair in about 9.6 seconds on an NVIDIA H100.
  • Generalization: Qualitative results showed the same pipeline successfully detecting deforestation and urban growth across different sensors (PlanetScope vs. Sentinel-2) without any modification.
Figure 2. Qualitative comparison on LEVIR-CD. Columns: image at t0, image at t1, SpotDiff similarity map, SpotDiff prediction, OmniOVCD prediction, ground truth. White: true positive; red: false positive; cyan: false negative.

Limitations and Future Work

While powerful, SpotDiff has a few constraints:

  • Fixed Thresholds: It currently relies on a fixed similarity threshold ($\tau$), which might need manual tuning for very different environments.
  • Registration Dependency: It assumes images are perfectly co-registered (aligned). Misalignment would lead to false change detections.
  • Amorphous Classes: It works best on "object-like" categories (buildings, cars). It is less effective for amorphous changes like "impervious surface" or subtle vegetation health shifts.
  • RGB Only: The current study focused on RGB imagery; extending this to multi-spectral or SAR (Radar) data is a key next step.

Summary updated

Abstract

Remote sensing change detection usually relies on large collections of temporally aligned, pixel-level annotations, which limits its scalability across regions, imaging platforms and application domains. Recent zero-shot approaches reduce the need for supervision, but they often localize fine-grained changes poorly because their features are coarse or inconsistent across time. We present SpotDiff, a training-free, plug-and-play framework for zero-shot change detection built by composing complementary vision foundation models. SpotDiff uses DINOv3 for semantically robust features, AnyUp to reconstruct them at pixel resolution, and SAM 3 for text-guided region-of-interest proposals, which an inference-time multi-scale strategy (SWIMS) makes reliable on small objects. Change is then measured by comparing the reconstructed features of the two dates inside the proposed regions, with no learnable components, fine-tuning or change labels. To our knowledge, SpotDiff is the first change detection method to use a universal feature upsampler, which alone adds 13.8 F1 over bilinear upsampling of the same features. On LEVIR-CD, SpotDiff reaches 82.46 F1, 2.06 points above the strongest prior training-free method, and on the multi-class SECOND benchmark it improves building change detection by 10.3 IoU and the six-class average by 2.2 IoU. Qualitative results on PlanetScope (3 m) and Sentinel-2 (10 m) imagery show that the same pipeline transfers across resolutions without modification. Our results indicate that composing modern foundation models is an effective route to scalable, label-free change detection.
BibTeX
@misc{upadhyaya2026spotdiff,
  author = {Anit Upadhyaya and Ata Akbari Asanjan and Chaitanya Jalluri and Subash Yeggina and Jeremy Kravitz},
  title = {{SpotDiff: A Plug-and-Play Framework for Zero-Shot Change Detection in Remote Sensing Imagery}},
  year = {2026},
  eprint = {2611.17172},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.17172},
}
Figure