The Non-Zero-Sum Game of Steganography in Heterogeneous Environments

Quentin Giboulot, Tomás Pevný, Andrew D. KerIEEE Trans. IFS 2023 · OpenReview

TL;DR

This paper introduces a more realistic game-theoretic model for steganography and steganalysis in diverse image environments. By framing it as a non-zero-sum game, they propose methods to find optimal strategies for both the steganographer and steganalyst, demonstrating that adapting to the environment significantly outperforms static approaches.

What Problem Does This Paper Address?

Steganalysis, the art of detecting hidden data within images, has traditionally been evaluated in controlled laboratory settings. However, real-world scenarios, like online image sharing, present a "heterogeneous environment" where images come from various sources (different cameras, settings, processing pipelines). This diversity has been a major hurdle for steganalysis techniques to perform reliably outside the lab. While deep learning has shown promise, existing models often fail to account for crucial real-world dynamics:

  1. Adaptive Steganographers: The steganographer can choose their "cover" image (the original image used for hiding data) strategically, adapting to the environment or the steganalyst's detection capabilities.
  2. Environmental Impact: The distribution of different cover image types in the environment influences the optimal detection threshold for the steganalyst.
  3. Divergent Goals: The steganographer aims to evade detection, while the steganalyst wants to detect hidden data while minimizing false alarms. These differing objectives mean they don't necessarily optimize the same metric.

This paper aims to bridge this gap by creating a more sophisticated model that captures these real-world complexities.

Methods

The core of the paper is the formulation of a non-zero-sum game between the steganographer and the steganalyst. This model explicitly incorporates:

  • Multiple Cover Sources: The environment is defined by a distribution over a finite set of distinct "cover sources."
  • Steganographer's Strategy: The steganographer chooses how to distribute their hidden data across these cover sources.
  • Steganalyst's Strategy: The steganalyst selects a classifier and a detection threshold.
  • Divergent Utilities: The steganographer's utility is primarily based on maximizing the probability of missed detection, while the steganalyst's utility balances detecting stego images and minimizing false alarms.

Crucially, the authors demonstrate that this non-zero-sum game is equivalent to a zero-sum game with the same Nash equilibria. This equivalence allows them to leverage established game-solving techniques. They propose two primary methods to find these equilibria:

  1. Double Oracle Algorithm: A standard iterative algorithm for solving large zero-sum games, adapted for continuous strategy spaces.
  2. Minimum Regret Classifier: A novel approach that aims to approximate the optimal strategies by minimizing a defined "regret" metric. This method is designed to be more computationally efficient than the double oracle algorithm, requiring fewer classifier trainings.

Datasets

The experiments were conducted using a dataset derived from 1150 RAW images from the ALASKA dataset. These images were processed to create 9 distinct cover source image sets, simulating heterogeneous environments. The steganography method used was JMiPOD, and the steganalysis was performed using a pre-trained EfficientNet-B3 model.

Key Insights and Ideas

  • Rational Steganographers Matter: Assuming the steganographer is rational and can adapt their cover source choice significantly changes the game. A static, "holistic" approach (training on all sources equally) is insufficient.
  • Environment is Key: The distribution of cover sources is not just a background factor; it directly influences the optimal strategies for both players.
  • Non-Zero-Sum is Necessary: The differing goals of the steganographer and steganalyst necessitate a non-zero-sum game formulation for accurate modeling.
  • Equivalence Simplifies Solutions: Converting the non-zero-sum game to an equivalent zero-sum game is a critical step that enables the application of powerful solution methods.
  • Trade-offs in Solutions: The Double Oracle algorithm offers stronger theoretical guarantees but is computationally expensive. The Minimum Regret classifier is more efficient but provides slightly weaker guarantees.

Key Results

  • Holistic Classifier Underperforms: Classifiers that don't adapt to the environment and the steganographer's rational strategy perform significantly worse. The paper shows an average performance degradation of 8.7% compared to optimal strategies.
  • Proposed Methods Outperform: Both the Double Oracle and Minimum Regret methods significantly outperform the holistic approach, achieving performance close to the ideal scenario where sources are perfectly identifiable. The difference from a Nash equilibrium was shown to be < 0.1% for Double Oracle and < 2.2% for the Minimum Regret method.
  • Computational Efficiency: The Minimum Regret classifier is approximately 10 times faster to train than the Double Oracle algorithm, making it more practical for real-world applications.
  • Steganographer's Strategy: The steganographer tends to avoid "easy" cover sources if they are not prevalent in the environment, and conversely, may favor prevalent but slightly harder-to-detect sources if the risk is low.

Limitations and Future Work

  • Simplified Steganographer Model: The paper assumes the steganographer uses a single algorithm with a fixed payload. Future work could explore more complex steganographic strategies.
  • Perfect Rationality Assumption: Both players are assumed to be fully rational and possess complete knowledge of the environment. In reality, the steganalyst might have more resources to estimate the environment.
  • Future Work: The authors suggest integrating these more realistic assumptions about player resources and environmental estimation into future models. They also highlight that the proposed Minimum Regret classifier can be applied to any detector based on a loss function, making it a versatile tool for robust steganalysis.

Summary updated

Abstract

The highly heterogeneous nature of images found in real-world environments, such as online sharing platforms, has been one of the long-standing obstacles to the transition of steganalysis techniques outside the laboratory. Recent advances in identifying the properties of images relevant to steganalysis as well as the effectiveness of deep neural networks on highly heterogeneous datasets have laid some groundwork for resolving this problem. Despite this progress, we argue that the way the game played between the steganographer and the steganalyst is currently modeled lacks some important features expected in a real-world environment: 1) the steganographer can adapt her cover source choice to the environment and/or to the steganalyst’s classifier, 2) the distribution of cover sources in the environment impacts the optimal threshold for a given classifier, and 3) the steganalyst and steganographer have different goals, hence different utilities. We propose to take these facts into account using a two-player non-zero-sum game constrained by an environment composed of multiple cover sources. We then show how to convert this non-zero-sum game into an equivalent zero-sum game, allowing us to propose two methods to find Nash equilibria for this game: a standard method using the double oracle algorithm and a minimum regret method based on approximating a set of atomistic classifiers. Applying these methods to contemporary steganography and steganalysis in a realistic environment, we show that classifiers which do not adapt to the environment severely underperform when the steganographer is allowed to select into which cover source to embed.
BibTeX
@article{giboulot2023non,
  author = {Quentin Giboulot and Tomás Pevný and Andrew D. Ker},
  title = {{The Non-Zero-Sum Game of Steganography in Heterogeneous Environments}},
  journal = {IEEE Trans. Inf. Forensics Secur.},
  year = {2023},
  url = {https://openreview.net/forum?id=C609o2wW0o},
}
Figure