Hiding Local Manipulations on SAR Images: a Counter-Forensic Attack

Sara Mandelli, Edoardo Daniele Cannas, Paolo Bestagini, Stefano Tebaldini, Stefano TubaroarXiv 2024 · arXiv

TL;DR

Researchers have developed a "counter-forensic" attack that can effectively hide local manipulations (like splicing) in Synthetic Aperture Radar (SAR) images. By simulating the physical re-acquisition process of the radar system, the attack obscures tampering traces, successfully deceiving state-of-the-art forensic detectors without requiring any knowledge of the detector's internal architecture.

What Problem Does This Paper Address?

Synthetic Aperture Radar (SAR) is a critical tool for remote sensing, capable of imaging through clouds and darkness. However, as SAR data becomes more accessible through online portals, it also becomes a target for malicious editing—such as inserting or removing military vehicles from a scene.

While the forensic community has developed advanced tools to detect these "splicing" attacks by looking for local inconsistencies in image statistics, these tools have a blind spot. Most SAR products are distributed as amplitude-only images, but the underlying signal is complex (amplitude + phase). The authors demonstrate that an attacker who understands the physics of SAR acquisition can exploit this complex nature to "re-process" a tampered image, making the forgery look like a legitimate, pristine acquisition.

Methods

The core idea is to simulate a SAR re-acquisition of the manipulated scene. The proposed pipeline, shown in Figure 5, consists of three main stages:

  1. Speckle Injection: SAR images are characterized by "speckle," a granular noise resulting from coherent interference. The attacker generates a complex speckle pattern and multiplies it with the manipulated amplitude image. This step is crucial because it restores the wide frequency spectrum typical of raw SAR data.
  2. SAR System Simulation: The complex, speckle-injected image is passed through a 2D transfer function $H$ that models the specific SAR satellite's acquisition and focusing process. This filters the image to match the spatial and frequency characteristics of the original system.
  3. Histogram Matching: Finally, the pixel distribution of the resulting image is adjusted to match the original manipulated image, ensuring the dynamic range remains consistent and avoiding visual artifacts.
Scheme of the proposed counter-forensic attack.

A key challenge for the attacker is knowing the transfer function $H$. The authors propose several estimation strategies (Gaussian fitting, Raised Cosine fitting, or direct estimation) that work even if the attacker only has access to a single original complex image or, in some cases, just the amplitude image.

Datasets

The researchers evaluated their attack using:

  • TerraSAR-X (ST-SSC): A dataset of ~12,000 pristine high-resolution (0.25m) complex SAR images from four geographical areas (Rome, Dublin, Gaza, and the Italian mountains).
  • MSTAR: A public dataset containing X-band complex SAR images of military tank targets, used to create realistic "hand-made" forgeries.
  • Automatic Splicing: A large-scale set of forgeries created by randomly splicing 128x128 pixel regions between images, subjected to various edits like blurring, rotation, and scaling.

Key Insights and Ideas

  • Physics-Based vs. Adversarial: Unlike typical "adversarial attacks" that use gradients to fool a specific neural network, this is a black-box physical attack. It targets the fundamental statistical properties of the SAR signal rather than a specific model's weights.
  • The Counter-Intuitive Role of Despeckling: While one might think removing noise (despeckling) before the attack would help, the authors found it actually degrades performance. Keeping the original speckle and letting the re-acquisition simulation supersede it preserves more high-frequency detail, leading to a more realistic result.
  • Speckle as a Forensic Shield: Speckle is often viewed as a nuisance to be removed, but here it acts as a mask. By correctly re-injecting and filtering speckle, the attacker hides the subtle interpolation and boundary artifacts left by editing software.
  • Failure of Standard Methods: Counter-forensic techniques designed for natural optical images (which often focus on simple denoising) fail completely on SAR data because they don't account for its unique granular properties.

Key Results

The attack was tested against three state-of-the-art detectors: SAE, ASAE, and TruForSAR.

  • Detection Blindness: In the presence of the attack, the Area Under the Curve (AUC) and Balanced Accuracy (BA) of the detectors dropped by approximately 25%.
  • Localization Failure: More strikingly, the F1 score and Intersection Over Union (IoU)—metrics that measure how well the detector actually outlines the forged area—dropped by more than 60%.
  • Visual Transparency: As seen in Figure 1, the attack leaves the semantic content (the "what" of the image) untouched but completely flattens the detector's heatmap, making the forgery indistinguishable from pristine background.
Fig. 1: High-level description of the paper goal. Given a manipulated SAR amplitude image (left), state-of-the-art SAR forensic detectors estimate a real- valued heatmap (second column) that highlights local image inconsistencies. Our proposed counter-forensic attack simulates a SAR re-acquisition of the manipulated image. The attack leaves untouched the semantic content of the image (third column), but it conceals its tampering traces, such that the estimated heatmap (right) does not allow anymore to localize the forgery. The manipulation area is surrounded by the red contour.

Limitations and Future Work

The authors acknowledge that the attack is most effective when the attacker has access to at least one complex SAR image from the same satellite to estimate the transfer function. While it can work with amplitude-only data, the results are less consistent.

Future Directions: * ATR Vulnerability: Investigating if this attack can also deceive Automatic Target Recognition (ATR) models used for automated military intelligence. * Cross-System Attacks: Testing if a manipulation can be disguised as having been captured by a different satellite system than the one actually used. * Counter-Counter-Forensics: The authors suggest that forensic analysts could potentially defend against this by including "attacked" images in their training sets, though this remains an open challenge in the cat-and-mouse game of image forensics.

Summary updated

Abstract

The vast accessibility of Synthetic Aperture Radar (SAR) images through online portals has propelled the research across various fields. This widespread use and easy availability have unfortunately made SAR data susceptible to malicious alterations, such as local editing applied to the images for inserting or covering the presence of sensitive targets. Vulnerability is further emphasized by the fact that most SAR products, despite their original complex nature, are often released as amplitude-only information, allowing even inexperienced attackers to edit and easily alter the pixel content. To contrast malicious manipulations, in the last years the forensic community has begun to dig into the SAR manipulation issue, proposing detectors that effectively localize the tampering traces in amplitude images. Nonetheless, in this paper we demonstrate that an expert practitioner can exploit the complex nature of SAR data to obscure any signs of manipulation within a locally altered amplitude image. We refer to this approach as a counter-forensic attack. To achieve the concealment of manipulation traces, the attacker can simulate a re-acquisition of the manipulated scene by the SAR system that initially generated the pristine image. In doing so, the attacker can obscure any evidence of manipulation, making it appear as if the image was legitimately produced by the system. This attack has unique features that make it both highly generalizable and relatively easy to apply. First, it is a black-box attack, meaning it is not designed to deceive a specific forensic detector. Furthermore, it does not require a training phase and is not based on adversarial operations. We assess the effectiveness of the proposed counter-forensic approach across diverse scenarios, examining various manipulation operations.
BibTeX
@misc{mandelli2024hiding,
  author = {Sara Mandelli and Edoardo Daniele Cannas and Paolo Bestagini and Stefano Tebaldini and Stefano Tubaro},
  title = {{Hiding Local Manipulations on SAR Images: a Counter-Forensic Attack}},
  year = {2024},
  eprint = {2407.07041},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2407.07041},
}
Figure