HMARK: Radioactive Multi-Bit Semantic-Latent Watermarking for Diffusion Models

Kexin Li, Guozhen Ding, Ilya Grishchenko, David LiearXiv 2025 · DOI · arXiv

Introduction

The rapid advancement of generative AI, particularly diffusion models (DMs), has created an unprecedented demand for high-quality training data. This demand often leads to the unauthorized scraping of creative works, raising significant intellectual property (IP) and ethical concerns. While traditional watermarking techniques can identify unauthorized use of individual images, they typically fail to protect the data source once a new model is trained on that data.

HMARK introduces a "radioactive" watermarking scheme designed specifically for this challenge. A radioactive watermark is one that "infects" the downstream model: if an AI is trained on watermarked images, its generated outputs will also carry the watermark, allowing data owners to prove unauthorized use of their datasets with near-perfect detection accuracy.

The HMARK Framework

HMARK operates within the semantic-latent space (h-space) of diffusion models, specifically targeting the UNet bottleneck layer. This approach offers a distinct advantage over pixel-level or abstract latent modifications. Because the h-space is semantically significant, changes here correspond to meaningful attributes like facial features or lighting, making the watermark more robust and harder to remove without degrading image quality.

Pipeline and Optimization

The HMARK pipeline involves training an encoder ($E_\theta$) to map a multi-bit secret (e.g., an 8-bit or 32-bit ID) into a residual ($\Delta h$) that is added to the h-space during the diffusion process. The system is optimized using a multi-objective loss function that balances four key criteria:

  1. Detectability: Ensuring the decoder can identify the presence of a watermark.
  2. Secret Recovery: Accurately extracting the specific multi-bit secret.
  3. Fidelity: Maintaining low mean squared error (MSE) relative to the original image.
  4. Perceptual Quality: Ensuring the watermarked image remains natural to human observers (using LPIPS loss).
Figure 4: Comparison of original and HMARK-watermarked images across different subjects, demonstrating high visual fidelity and minimal perceptual distortion.

Radioactivity and Robustness

The core innovation of HMARK is its ability to create a coherent distribution shift. By applying a consistent semantic shift across a dataset for a specific secret, the downstream model learns this shift as an inherent part of the data distribution. Consequently, any images generated by the fine-tuned model naturally reproduce this learned semantic bias.

To ensure robustness against common image manipulations, HMARK is trained with distortion-aware perturbations, including blur, noise, and compression. Furthermore, the integration of BCH (Bose-Chaudhuri-Hocquenghem) error correction codes allows for the reliable recovery of longer secrets (up to 32 bits), which is essential for applications like traitor tracing—identifying the specific source of a data leak.

Experimental Evaluation

The system was trained on 100,000 images generated from a semantic DDPM and evaluated using 10,000 samples from the CelebA-HQ dataset. To test radioactivity, the researchers fine-tuned downstream models using both Low-Rank Adaptation (LoRA) and full UNet fine-tuning on the watermarked data.

Key Results

HMARK demonstrates impressive performance across several metrics:

  • Detection Performance: HMARK achieved a 98.57% detection accuracy and a 1.0 AUC on images generated by models trained on watermarked data.
  • Bit Accuracy: For 8-bit secrets, the system reached a 95.07% bit-level recovery accuracy.
  • Visual Fidelity: Watermarked images maintained high SSIM scores (over 0.96) and low perceptual distance, making the watermark virtually invisible to the naked eye.
  • Baseline Comparison: HMARK significantly outperformed existing methods like "Recipe," which saw its detection accuracy drop to near-random levels (approx. 50%) after model fine-tuning.

Conclusion and Future Work

HMARK represents a significant advancement in IP protection for the generative AI era. By leveraging the semantic-latent space to create radioactive, multi-bit watermarks, it provides a robust mechanism for creators to track and verify the use of their data.

Future work may address current limitations, such as the model-specific nature of the current implementation (primarily DDPMs) and the sensitivity to fine-tuning duration. The authors noted that radioactivity is strongest after 6,000 to 9,000 fine-tuning steps. Despite these challenges, HMARK paves the way for a more accountable and verifiable digital ecosystem where creators can protect their intellectual property against unauthorized AI training.

This summary is based on the research paper "HMARK: Radioactive Multi-Bit Semantic-Latent Watermarking for Diffusion Models."

Summary updated

Abstract

Modern generative diffusion models rely on vast training datasets, often including images with uncertain ownership or usage rights. Radioactive watermarks -- marks that transfer to a model's outputs -- can help detect when such unauthorized data has been used for training. Moreover, aside from being radioactive, an effective watermark for protecting images from unauthorized training also needs to meet other existing requirements, such as imperceptibility, robustness, and multi-bit capacity. To overcome these challenges, we propose HMARK, a novel multi-bit watermarking scheme, which encodes ownership information as secret bits in the semantic-latent space (h-space) for image diffusion models. By leveraging the interpretability and semantic significance of h-space, ensuring that watermark signals correspond to meaningful semantic attributes, the watermarks embedded by HMARK exhibit radioactivity, robustness to distortions, and minimal impact on perceptual quality. Experimental results demonstrate that HMARK achieves 98.57% watermark detection accuracy, 95.07% bit-level recovery accuracy, 100% recall rate, and 1.0 AUC on images produced by the downstream adversarial model finetuned with LoRA on watermarked data across various types of distortions.
BibTeX
@misc{li2025hmark,
  author = {Kexin Li and Guozhen Ding and Ilya Grishchenko and David Lie},
  title = {{HMARK: Radioactive Multi-Bit Semantic-Latent Watermarking for Diffusion Models}},
  year = {2025},
  eprint = {2512.00094},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2512.00094},
}
Figure