When Agents Play Differently: Localizing Human--Agent Behavioral Divergence with Conditional Distributional Testing

Oleg Smirnov, John Pertoft, Sara KarimiarXiv 2026 · arXiv

TL;DR

Evaluating AI agents based on average performance (like win rates) often fails to capture how "human-like" they actually are. This paper introduces a framework for Conditional Distributional Testing that localizes exactly where and how an agent’s behavior diverges from humans across different game contexts, providing developers with a human-readable "map" for targeted improvements.

What Problem Does This Paper Address?

In game development, "believable" agents are essential for automated playtesting and balancing. However, current evaluation methods usually rely on aggregate scalar metrics—like average scores or success rates.

The authors argue that these metrics are insufficient for two reasons:

  1. Distributional Blindness: Two agents can have the identical average score but vastly different playstyles. One might be highly consistent, while the other relies on high-risk, high-reward strategies.
  2. Outcome Dominance: Many metrics (like "total moves used") are so tightly coupled with whether the agent won or lost that they don't reveal anything about the process of play.

If a bot is validated only on aggregate win rates, it might still play a level in a bizarre, non-human way, leading designers to misjudge the actual player experience.

Fig. 1: Illustrative example. Two groups with the same mean move efficiency but different distributions: human play is more variable and heavier-tailed than the more consistent agent. A mean comparison reports no difference, whereas a distributional test detects it.

Methods

The authors propose a three-stage pipeline to move from a global "believability" verdict to localized, actionable insights:

  1. Stratified Discrepancy Estimation: The game data is broken down into "contextual cells" (e.g., a specific game mode at a specific difficulty). Within each cell, they use Maximum Mean Discrepancy (MMD)—a nonparametric test—to compare the full distribution of human vs. agent behavior.
  2. Partial Pooling: To handle "noisy" cells with small sample sizes, they apply a random-effects model that shrinks estimates toward the global mean, ensuring that reported divergences are statistically robust.
  3. Interpretable Rule Discovery: Finally, they use a greedy decision tree (similar to CART) to partition the context space. This generates a "rule tree" that identifies specific subgroups (e.g., "Mode: Chain AND Difficulty > 1") where the agent departs most significantly from human play.

Datasets

The framework was validated using a production-scale dataset from a commercial match-3 mobile game:

  • Human Data: ~110,000 player sessions.
  • Agent Data: ~5,000 sessions each for two distinct bots:
  • SL (Supervised Learning): A behavioral cloning model trained on human play.
  • Hbot (Heuristic): A handcrafted bot using "hint-based" strategies.
  • Contexts: 24 cells defined by 4 difficulty levels and several game modes (Chain, Clear, Route).

Key Insights and Ideas

  • The "Process vs. Outcome" Distinction: The authors show that metrics like "score per move" or "cascades per move" are far more informative than win rates. These "process-level" metrics capture how the game is played, which is where true behavioral divergence lives.
  • Contextual Dissociation: A major "aha!" moment was discovering that different agent architectures fail in different places. The SL bot (trained on humans) diverged most in "Chain" modes, failing to replicate the long, high-variance cascades humans often trigger. In contrast, the heuristic Hbot diverged more in objective-driven modes like "Clear."
  • Actionable Diagnostics: Instead of a developer hearing "the bot isn't human-like," the rule tree provides a specific target: "The bot is non-human specifically on easy Chain levels." This allows for targeted fine-tuning rather than blind architectural changes.
Fig. 3: Distributions of cascades per move for humans and the two agents in a strongly divergent cell (left) and a near-aligned cell (right). Dashed lines mark group means. In Chain the agents concentrate at lower cascade rates and rarely sustain the long chains humans produce, and in hard Clear the three distributions nearly coincide.

Key Results

  • Synthetic Validation: In a controlled test with "planted" divergences that mean-based metrics couldn't see, the MMD-based pipeline recovered the divergent regions with 0.94 precision and 1.00 recall.
  • Real-World Discovery: The pipeline successfully identified a "shared alignment subgroup." Both the SL and Heuristic bots were found to be highly human-like on "Hard Clear" levels (MMD $\Delta \approx 0.001$, non-significant), but diverged sharply elsewhere.
  • Structural Divergence: The rule trees (Figure 4) revealed that the SL bot’s biggest weakness was its inability to sustain long cascades, a behavior humans naturally exploit in specific game modes.
Fig. 4: Rule trees for the SL bot (left) and Heuristic bot (right). Red nodes indicate significant divergence. Note how the SL bot's divergence is concentrated in the "Chain" mode.

Limitations and Future Work

  • The Ignorability Assumption: The method assumes all variables affecting behavior are included in the context covariates. If a key context (like a specific board mechanic) is missing, the divergence might remain "diffuse" and hard to localize.
  • Goodhart’s Law: The authors warn that using these discrepancy statistics directly as a reward signal for training agents could lead to "metric hacking" rather than genuine behavioral improvement.
  • Spatial Understanding: The findings suggest agents might lack the spatial reasoning required for complex human-like strategies (like setting up cascades). Future work could involve testing different neural architectures to see which best closes these specific, localized gaps.

Summary updated

Abstract

Evaluating whether artificial agents behave like humans requires comparing not just average outcomes but entire behavioral distributions across diverse contexts. We propose a stratified framework that computes nonparametric discrepancy statistics within contextual cells, and discovers subgroup rules identifying where agent behavior departs from human play. We show that session-level metrics dominated by win/loss outcomes offer little signal beyond mean comparisons, whereas process-level metrics such as move efficiency reveal genuine behavioral differences. Applied to a commercial match-3 game, it uncovers patterns invisible to aggregate metrics: a playtesting bot is diverging substantially from humans in certain game modes, while showing no detectable divergence in others. We release our implementation as open source to support reproducibility and adoption.
BibTeX
@misc{smirnov2026when,
  author = {Oleg Smirnov and John Pertoft and Sara Karimi},
  title = {{When Agents Play Differently: Localizing Human--Agent Behavioral Divergence with Conditional Distributional Testing}},
  year = {2026},
  eprint = {2611.26012},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.26012},
}
Figure