SpiderMark: Hybrid Watermarking for Generative AI via Algorithmic Injection and Learning-Based Verification

Chihcheng Hsieh, Yang Song, Flora Salim, Martin Bell, Jacinto C. Nascimento, Catarina MoreiraarXiv 2026 · arXiv

TL;DR

SpiderMark is a novel hybrid watermarking framework for diffusion models that combines a geometrically structured "spider-web" frequency-domain injection with a learning-based probabilistic verifier. By moving away from simple circular patterns and handcrafted thresholds, it achieves superior robustness against common image distortions—like motion blur and cropping—without requiring any modifications to the weights of pretrained generative models.

What Problem Does This Paper Address?

As AI-generated imagery becomes indistinguishable from reality, the need for reliable "provenance" (tracing an image back to its source) has become a critical technical and regulatory challenge. Current "in-generation" watermarking methods—which embed signatures directly into the diffusion process—suffer from two main flaws:

  1. Directional Vulnerability: Most methods use isotropic (circular) frequency patterns. While these are invariant to rotation, they are easily erased by directional distortions like motion blur or anisotropic resampling.
  2. Threshold Instability: Traditional verification relies on handcrafted metrics (like correlation) and a fixed threshold. However, the "optimal" threshold for a clean image is often very different from the one needed for a JPEG-compressed or cropped image, making real-world deployment unreliable.

SpiderMark aims to bridge this gap by introducing structured geometry and learned verification into a single, practical framework.

Methods

The SpiderMark pipeline is divided into two distinct phases: Injection and Verification.

1. Algorithmic Injection

Instead of retraining the diffusion model, SpiderMark modifies the initial latent noise ($x_T$) before the denoising process begins. It embeds a spider-web pattern—consisting of radial spokes and concentric polygonal rings—into the Fourier representation of the noise.

Overview of the SpiderMark framework showing the injection and training phases.

The radial spokes provide "angular" evidence that circular rings lack, making the watermark much harder to remove with directional blurs. This process is lightweight and works with existing models like Stable Diffusion v2.1 and SDXL.

2. Learning-Based Verification

To solve the threshold instability problem, the authors replace handcrafted metrics with a neural network.

  • Recovery: The system uses inverse DDIM to approximately recover the initial latent noise from a generated image.
  • The Verifier: A lightweight ResNet-18 backbone processes the Fourier magnitude of the recovered latent.
  • Hybrid Cues: Crucially, the model is augmented with auxiliary similarity cues—specifically PSNR and L1 distance—calculated between the recovered spectrum and the known watermark pattern. This allows the network to fuse deep feature learning with traditional signal-processing metrics.
Fig. 2. Verifier (fθ) Architecture. Given an input image (x), we first recover its corresponding watermark latent via inverse DDIM (IDDIM) followed by a Fourier transform (F). The resulting frequency-domain representation is processed by a pretrained ResNet-18 verifier, augmented with auxiliary similarity cues (PSNR and L1) computed against the fixed SpiderMark pattern (W). The verifier outputs a probabilistic prediction indicating whether the image is watermarked.

Datasets

  • Training: The authors generated a balanced dataset of 1,000 images (500 clean, 500 watermarked) using prompts from the Gustavosta/Stable-Diffusion-Prompts collection and Stable Diffusion v2.1.
  • Evaluation: To test generalization, the model was evaluated on the COCO dataset (unseen prompts). This ensures the verifier is learning the watermark's spectral signature rather than overfitting to specific prompt styles.

Key Insights and Ideas

  • Geometry as a Defense: The "aha moment" here is that isotropic patterns (rings) are a weakness, not just a simplification. By adding radial spokes, SpiderMark creates spatial redundancy. Even if a portion of the frequency spectrum is corrupted by a specific distortion, the interconnected lattice of the spider-web preserves enough cues for detection.
  • Probabilistic vs. Binary: By training a verifier to output a continuous confidence score, the system becomes "confidence-aware." This is far more useful for real-world decision-making than a simple "yes/no" based on a rigid, unstable threshold.
  • Zero-Weight Modification: The framework proves that high-performance watermarking doesn't require expensive fine-tuning of the generative model itself. This makes it highly portable across different architectures.

Key Results

SpiderMark was tested against nine different image transformations, including aggressive JPEG compression, Gaussian blur, and geometric warping.

  • Superior Accuracy: SpiderMark achieved the highest fixed-threshold accuracy in 8 out of 9 evaluation conditions compared to baselines like Tree-Ring watermarking.
  • Robustness to Blur: On blurred images, SpiderMark maintained an accuracy of ~81.6%, while the popular Tree-Ring method dropped to ~47.7%.
  • Generalization: When tested on the unseen COCO dataset, SpiderMark retained its lead, achieving 97.3% accuracy on clean images and remaining robust across all attack vectors without any retraining.
  • Minimal Quality Trade-off: FID and CLIP similarity scores showed that the watermark has a negligible impact on image quality and prompt alignment, maintaining the "photorealism" of the original model.

Limitations and Future Work

  • Binary Payload: Currently, SpiderMark only detects the presence of a watermark (1 bit). It does not yet support multi-bit payloads (e.g., encoding a specific user ID or model version).
  • Informed Removal: If an attacker knows the exact spider-web pattern and its frequency support, they can still attempt to "zero out" those coefficients. The authors suggest that future work could involve "keyed" families of patterns to prevent this.
  • Security Scope: The paper focuses on robust provenance (handling downstream processing) rather than cryptographic security against a fully informed, adversarial attacker.

Overall, SpiderMark represents a significant step toward making AI watermarking "production-ready" by combining the mathematical rigor of frequency-domain analysis with the flexibility of deep learning.

Summary updated

Abstract

The proliferation of diffusion-based generative models has intensified the need for reliable methods to trace and verify the provenance of AI-generated images. Existing watermarking approaches for diffusion models typically rely on isotropic frequency patterns and handcrafted detection metrics, which are prone to directional vulnerability and threshold instability across diverse image transformations. We propose SpiderMark, a hybrid watermarking framework that combines algorithmic frequency-domain injection with learning-based probabilistic verification, requiring no modifications to pretrained diffusion model weights. SpiderMark embeds a structured spider-web pattern, comprising radial spokes and concentric polygonal rings, into the Fourier representation of the initial latent noise, and trains a lightweight ResNet-18 verifier augmented with auxiliary similarity cues (PSNR and L1) to produce a continuous watermark confidence score for watermark detection. Across nine evaluation conditions, SpiderMark achieves the highest fixed-threshold Accuracy in eight, while retaining strong detection on unseen COCO prompts without verifier retraining. CLIP similarity and FID measurements show that these detection gains are accompanied by small measured differences in prompt alignment and distributional image quality. SpiderMark establishes that structured watermark geometry and learned probabilistic verification can be unified into a single, practical framework, bridging the gap between imperceptibility, robustness, and real-world verifiability for generative AI content attribution.
BibTeX
@misc{hsieh2026spidermark,
  author = {Chihcheng Hsieh and Yang Song and Flora Salim and Martin Bell and Jacinto C. Nascimento and Catarina Moreira},
  title = {{SpiderMark: Hybrid Watermarking for Generative AI via Algorithmic Injection and Learning-Based Verification}},
  year = {2026},
  eprint = {2611.24200},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.24200},
}
Figure