Detecting Looted Archaeological Sites from Satellite Image Time Series

Elliot Vincent, Mehraïl Saroufim, Jonathan Chemla, Yves Ubelmann, Philippe Marquis, Jean Ponce, Mathieu Aubry

TL;DR

The authors introduce DAFA-LS, the first open-access satellite image time series (SITS) dataset designed specifically for detecting archaeological looting, featuring over 55,000 monthly images of 675 Afghan sites over an 8-year period. By benchmarking various computer vision approaches, they demonstrate that combining remote sensing foundation models with temporal attention mechanisms provides a massive boost in identifying subtle, illicit landscape changes amidst heavy seasonal noise.

What Problem Does This Paper Address?

Archaeological sites are invaluable windows into human history, but they are increasingly threatened by pillaging and conflict, particularly in unstable regions where ground-truth surveys are dangerous or impossible. While satellite imagery offers a viable alternative for remote monitoring, automating the detection of looting remains an open challenge.

Looting marks (such as small pits or bulldozer scars) are incredibly subtle and easily confused with irrelevant environmental changes like seasonal vegetation growth or shifting sands. Furthermore, progress in this niche field has been severely bottlenecked by a lack of data: prior studies relied on proprietary, non-multi-temporal, or completely private datasets, making it difficult for the broader machine learning community to contribute.

Figure 1: DAFA Looted Sites (DAFA-LS) contains monthly satellite image time series (SITS) of Afghan archaeological sites acquired between 2016 and 2023. We show the location of preserved (a) and looted (b) sites, adding strong random noise to their coordinates to prevent misuse of the data. Test sites are marked with a star (⋆). We also show images (d-f) from two sites (c): Ancient Balkh (in blue, top row) has been preserved from looting [80], while Dilberjin (in red, bottom row) suffered irreparable damage.

Datasets

To bridge this gap, the authors present the DAFA Looted Sites dataset (DAFA-LS). Curated in collaboration with expert archaeologists from the French archaeological delegation in Afghanistan (DAFA) and the startup Iconem, it contains:

  • 55,480 RGB images captured monthly between 2016 and 2023.
  • 675 unique Afghan archaeological sites, consisting of 135 looted and 540 preserved sites.
  • 3 meters per pixel ground resolution sourced from Planet Basemaps.
  • Coarse binary location masks manually annotated by experts to outline each site, helping models focus on the relevant area and avoid surrounding geographic biases (like nearby roads).

To prevent malevolent actors from using this dataset to locate and exploit intact sites, the authors intentionally added strong random noise to the spatial coordinates and applied geometric transformations to the distributed images.

Figure 2: Examples of time series and coarse location masks. For each archaeological site, we show the September image for each year from 2016 to 2023 and the corresponding coarse location mask. The 4 top rows show looted sites (red squares) and the 4 bottom rows show preserved sites (blue squares).

Compared to existing datasets in the literature, DAFA-LS stands out as the only open-access dataset that provides both high temporal resolution (monthly) and a substantial number of sites.

Table 1: Aerial and satellite image datasets for archaeological site looting detection. In Masini et al. [53], images were acquired with Google Earth with varying spatial resolution. El Hajj [24] does not provide open access to their dataset, but it can theoretically be recreated openly since (i) locations, images and labels come from open-source data, and (ii) the pre-processing steps are detailed in the paper.

Methods

The authors evaluated three distinct paradigms for satellite image time series classification:

  1. Single-frame methods: Standard architectures (like ResNets) and frozen foundation models (SatMAE, Scale-MAE, DOFA) trained only on 2023 images, operating under the assumption that looting marks remain visible in the final year's data.
  2. Pixel-wise multi-frame methods: Models (like TempCNN and DuPLo) that treat each pixel within the site mask as an independent time series, completely discarding spatial context.
  3. Whole-image multi-frame methods: Spatio-temporal architectures (like TSViT and UTAE) or foundation models paired with a Lightweight Temporal Attention Encoder (LTAE). This approach processes the entire image patch across all timestamps, capturing both spatial structures and temporal dynamics.

Key Insights and Ideas

  • Spatial Context is Non-Negotiable: Whole-image multi-frame methods drastically outperformed pixel-wise methods. A looting pit cannot be identified by a single pixel's trajectory; the model must see the structural "scars" relative to the surrounding terrain.
  • The Power of Foundation Models: Remote sensing foundation models—specifically DOFA (pretrained on over 8 million diverse satellite images)—provided a massive performance leap. Even though DOFA wasn't trained on this specific sensor resolution, its generalized representations transferred exceptionally well to this niche task.
  • Temporal Attention Filters Out Seasonality: Incorporating the full time series via LTAE allowed the network to learn when to look. Ablation studies showed that the temporal attention mechanism naturally prioritized specific years (like 2020 and 2021, when major looting surges occurred) and downweighted confusing seasonal vegetation changes.

Key Results

The combination of the DOFA foundation model and the LTAE temporal encoder (DOFA+LTAE) delivered the best overall performance across all metrics:

  • Overall Accuracy (OA): 78.7% (outperforming the best standard multi-frame baseline, UTAE, by 16.7 percentage points).
  • F1-Score: 74.9%
  • AUROC: 87.1%

Interestingly, while the single-frame DOFA model achieved a slightly lower false alarm rate (FAR) of 7.4%, incorporating the full time series (DOFA+LTAE) boosted the F1-score by +7.9 points, proving that temporal tracking is vital for minimizing missed looting events.

Limitations and Future Work

The primary limitation of DAFA-LS is its geographic homogeneity. Because all 675 sites are located in the arid, desertic regions of Afghanistan, the models trained on this dataset will likely struggle in regions with dense vegetation canopy (e.g., tropical jungles), where alternative modalities like SAR (Synthetic Aperture Radar) or LiDAR are required.

Additionally, the dataset only provides weak, series-level binary labels ("looted" vs. "preserved") rather than pixel-level annotations or exact timestamps of when the looting occurred. The authors suggest that exploring unsupervised change detection methods could be a promising next step to pinpoint exact looting dates without requiring tedious manual labeling.

Summary updated

Abstract

Archaeological sites are the physical remains of past human activity and one of the main sources of information about past societies and cultures. However, they are also the target of malevolent human actions, especially in countries having experienced inner turmoil and conflicts. Because monitoring these sites from space is a key step towards their preservation, we introduce the DAFA Looted Sites dataset, \datasetname, a labeled multi-temporal remote sensing dataset containing 55,480 images acquired monthly over 8 years across 675 Afghan archaeological sites, including 135 sites looted during the acquisition period. \datasetname~is particularly challenging because of the limited number of training samples, the class imbalance, the weak binary annotations only available at the level of the time series, and the subtlety of relevant changes coupled with important irrelevant ones over a long time period. It is also an interesting playground to assess the performance of satellite image time series (SITS) classification methods on a real and important use case. We evaluate a large set of baselines, outline the substantial benefits of using foundation models and show the additional boost that can be provided by using complete time series instead of using a single image.
BibTeX
@inproceedings{vincent2025detecting,
  author = {Elliot Vincent and Mehraïl Saroufim and Jonathan Chemla and Yves Ubelmann and Philippe Marquis and Jean Ponce and Mathieu Aubry},
  title = {{Detecting Looted Archaeological Sites from Satellite Image Time Series}},
  booktitle = {Workshops @ CVPR},
  year = {2025},
}
Figure