SemVideoSte: Agentic AI for Cross-Modal Semantic Video Steganography Communication

Rui Meng, Song Gao, Tingting Zhu, Zixun Tang, Jinke Ren, Xiaodong Xu, Pei Xiao, Shuguang Cui, Ping ZhangarXiv 2026 · arXiv

TL;DR

SemVideoSte is a novel framework that uses "Agentic AI" to hide secret text messages within AI-generated videos. By leveraging diffusion models and a sophisticated multi-masking mechanism, it achieves high-capacity, "coverless" steganography that is remarkably robust to the noise and distortions of wireless semantic communication channels.

What Problem Does This Paper Address?

As we move toward 6G, Semantic Communication (SemCom) is becoming vital. Instead of sending raw pixels, SemCom transmits the "meaning" or essential features of data to save bandwidth. However, these systems often need to exchange sensitive auxiliary info—like device IDs or control commands—alongside the video.

Traditional encryption protects the content of these messages but doesn't hide their existence, potentially alerting eavesdroppers. Steganography hides the message inside a "carrier" (like a video), but existing methods struggle with two things:

  1. Temporal Inconsistency: Modifying video frames often creates "glitches" or unnatural motion that steganalysis tools can easily spot.
  2. Transmission Fragility: The lossy nature of wireless channels and the compression in SemCom often destroy the hidden bits before they reach the receiver.

Methods

The authors introduce SemVideoSte, which shifts from "editing" a video to "generating" one that already contains the message.

1. Agentic AI Coordinator

The system isn't just a fixed algorithm; it's an Agentic AI that follows a "Perception-Memory-Reasoning-Action" workflow. It interprets the service context to pick a natural-looking video prompt (the "Public Key") and coordinates the entire embedding and transmission pipeline.

Fig. 2: Agentic AI workflow in the proposed SemVideoSte framework. Agentic AI performs perception, memory , reasoning, and action to coordinate public key generation, digital token setting, mask filtering, stego video generation, semantic transmission, and secret message recovery to achieve semantic video steganography communication.

2. Multi-Mask Latent Selection

To ensure the message survives the journey, the agent generates three specific masks to find the "perfect" spots in the video's latent space to hide data:

  • VAE Mask ($M_{vae}$): Filters out positions unstable during basic image reconstruction.
  • Semantic Mask ($M_{sem}$): Filters out positions vulnerable to wireless channel noise and semantic codec distortion.
  • Separation Mask ($M_{sep}$): Identifies positions that show clear, distinguishable differences when "nudged" by the secret bits.
Fig. 3: The generation process of the final embedding mask. Three masks are constructed to evaluate VAE reconstruction robustness, semantic trans- mission robustness, and latent separation under token-controlled guidance, respectively. Their intersection forms the final mask Mfinal, which selects reliable and separable latent positions for secret message embedding.

3. Coverless Embedding via Diffusion

Instead of tweaking pixels, the message is embedded during the Diffusion Denoising process. Using a private digital token (a secret seed), the transmitter applies "Classifier-Free Guidance" (CFG) offsets. At the final sampling step, the latent state is pushed toward a "positive" state to represent a 1 or a "negative" state for a 0. Because the message is part of the generation process, there are no "edit marks" for eavesdroppers to find.

Datasets

  • SwinJSCC Training: The semantic codec was trained on the CelebA-HQ dataset.
  • Evaluation: The system was tested using 100 public key prompts (e.g., "A plane taxiing down the runway...") to generate diverse video content.
  • Steganalysis: Evaluation against four representative steganalyzers (LWENet, XuNet, SRNet, and CovNet) used a dataset of 100 cover-stego video pairs (8,100 frame pairs).

Key Insights and Ideas

  • The "Agentic" Advantage: By treating the system as an agent, it can adaptively choose prompts that are "steganography-friendly"—avoiding chaotic motion or unstable textures that would make message recovery difficult.
  • Coverless is Key: By generating the carrier and the message simultaneously, the framework bypasses the "capacity vs. quality" trade-off found in traditional cover-modified steganography.
  • Robustness through Simulation: The "Semantic Mask" is generated by the agent simulating the noisy wireless channel before actually sending the data, ensuring it only hides bits in the most resilient parts of the video.

Key Results

  • High Capacity: Achieves an average embedding capacity of over 2,200 bits per video.
  • Reliability: Even in noisy conditions (SNR = 10 dB), the message recovery accuracy is 99.72%.
  • Visual Quality: The "stego" videos maintain high fidelity, with a PSNR of 34.89 dB and a BERTScore F1 of 0.98 for the recovered text.
  • Security: Eavesdroppers without the private digital token (the secret seed) are reduced to roughly 50% accuracy (random guessing).
  • Practicality: The authors successfully deployed the system on NVIDIA Jetson AGX Thor edge devices, proving it can run on real-world hardware.

Limitations and Future Work

The current simulation uses a GOP (Group of Pictures) setting of 1, meaning each frame is encoded independently. While this simplifies the study of channel noise, real-world video codecs usually use temporal prediction (inter-frame coding). The authors note that future work should explore more complex temporal semantic transmission strategies. Additionally, while the "Agentic" approach is powerful, the computational overhead of running diffusion models on edge devices remains a challenge for real-time applications.

Summary updated

Abstract

We propose an agentic artificial intelligence (AI)-driven cross-modal semantic video steganography communication (SemVideoSte) scheme for secure cross-modal information transmission. Agentic AI interprets the service context to determine a semantically matched public prompt and coordinates video generation, message embedding, semantic transmission, and message recovery process. A multi-mask mechanism combines variational autoencoder (VAE) reconstruction robustness, semantic transmission robustness, and latent separability to select reliable embedding positions. Meanwhile, a private digital token controls the random seed and guidance offset to construct positive and negative terminal latent states, enabling coverless message embedding during the final diffusion sampling step. Simulation results on open-source datasets demonstrate that SemVideoSte achieves high embedding capacity, reliable message recovery, and strong semantic consistency under different channel conditions. In addition, eavesdroppers without the correct digital token cannot reliably recover the secret message, and the generated stego videos effectively resist the steganalysis detection. We further establish a prototype testbed to verify the practical feasibility of SemVideoSte.
BibTeX
@misc{meng2026semvideoste,
  author = {Rui Meng and Song Gao and Tingting Zhu and Zixun Tang and Jinke Ren and Xiaodong Xu and Pei Xiao and Shuguang Cui and Ping Zhang},
  title = {{SemVideoSte: Agentic AI for Cross-Modal Semantic Video Steganography Communication}},
  year = {2026},
  eprint = {2610.25257},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.25257},
}
Figure