Traditional large language model (LLM) evaluation relies heavily on static, single-turn benchmarks. If a model can select the correct answer on a multiple-choice exam or generate a self-contained snippet of code, it is deemed highly capable. However, as language models transition from passive text generators into autonomous agents, this evaluation paradigm breaks down entirely.
In an agentic workflow, a model does not output a final answer in a single turn. Instead, it executes an action, observes the environment's response, updates its internal state, and plans its next step over a long horizon. This shift introduces a fundamental challenge: compounding errors. A minor mistake in an early API call or user interface interaction can completely alter the environment's state, causing subsequent actions to fail. As noted by Peijie Dong et al. in Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression, standard metrics like perplexity or static multiple-choice accuracy fail to capture a model's ability to maintain coherence and execute multi-step planning within these interactive environments.
To bridge this "agentic evaluation gap," researchers are developing a new generation of benchmarks that simulate the complexity, messiness, and unpredictability of real-world tasks.
From Isolated Tools to Stateful Workflows
Early tool-use benchmarks focused on simple, linear sequences—essentially testing whether a model could correctly populate arguments for a single API call. Real-world applications are rarely so clean; they require integrating multiple services through conditional reasoning, data transformation, and state management.
To address this, recent frameworks stress-test models under realistic, multi-step constraints. For instance, the Berkeley Function Calling Leaderboard (BFCL), introduced by Shishir G Patil et al. in The Berkeley Function Calling Leaderboard (BFCL): From Tool Use to Agentic Evaluation of Large Language Models, evaluates agents on multi-turn interactions and complex state management. Their evaluation reveals that while modern models excel at basic, single-turn API execution, they struggle significantly with memory management and long-horizon reasoning when human queries become messy or unpredictable.
[Static Evaluation] Prompt ──> LLM ──> Static Text Output (Pass/Fail)
[Agentic Evaluation] Prompt ──> LLM ──> Action ──> Stateful Environment
▲ │
└────── Observation ◄───┘
The challenge intensifies when agents must orchestrate actions across entirely different applications. Harsh Trivedi et al. developed AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents, an environment simulating nine apps and hundreds of APIs. They demonstrated that tasks requiring data transformation and conditional logic across services cause even state-of-the-art models to fail roughly 70% of the time. The bottleneck is often not the model's high-level understanding, but its ability to handle the underlying protocol mechanics over time. This pattern is mirrored in MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Use, where Zijian Wu et al. found that managing stateful workflows across databases and enterprise pipelines remains a severe bottleneck for frontier models.
The Disconnect Between Reasoning and Execution
An intuitive assumption might be that an agent with superior semantic reasoning capabilities will naturally perform better in practical environments. However, interactive benchmarks reveal a stark disconnect between knowing what to do and actually executing it.
Consider web navigation and data retrieval. In DeepShop: A Benchmark for Deep Research Shopping Agents, Yougang Lyu demonstrates that while "deep research" agents can reason effectively about user intent, they frequently fail at basic user interface interactions, such as applying filters or sorting products on a live page.
This pattern repeats in highly technical domains. The authors of FinDeepIndicator: Benchmarking Deep Research Agents in End-to-End Financial Indicator Construction found that while LLMs can recite complex financial theories perfectly, they fail nearly 60% of the time when tasked with the end-to-end "legwork" of scraping unstructured data from diverse sources and executing multi-step calculations.
When environments become completely open-ended—such as the production-living simulations in StarDojo (Weihao Tan et al. in StarDojo: Benchmarking Open-Ended Behaviors of Agentic Multimodal LLMs in Production–Living Simulations with Stardew Valley) or the vast state spaces of Minecraft Universe (Xinyue Zheng et al. in MCU: An Evaluation Framework for Open-Ended Game Agents)—agents must balance material constraints, long-term survival, and error recovery. In these settings, fluid goals replace rigid programmatic targets, exposing the limitations of models that cannot dynamically adapt to unexpected environmental feedback.
Social Dynamics and Multi-Agent Coordination
When multiple agents are deployed together, evaluation must expand from individual task execution to social and strategic interaction. In real-world deployments, agents must cooperate, compete, and negotiate under mixed motives.
Traditional benchmarks fail to capture these dynamics because they ignore the social vulnerabilities that emerge when language models interact with one another. For example, the authors of Do as We Do, Not as You Think: the Conformity of Large Language Models discovered that multi-agent systems are highly susceptible to conformity and "groupthink." Because of the autoregressive nature of LLMs, once an incorrect majority opinion enters the shared context window, individual agents will frequently abandon their own correct reasoning to agree with the group.
To evaluate these complex behaviors, researchers have built dynamic arenas:
- Strategic Competition: Kunlun Zhu et al. introduced MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents to measure labor division and strategic competition, finding that advanced coordination protocols cannot salvage an agent if its underlying technical execution (like function calling) fails.
- Bargaining and Persuasion: Federico Bianchi et al. developed How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis to study multi-turn bargaining, revealing that models exhibit human-like irrationalities and are highly susceptible to behavioral manipulation.
- Generalization to Social Norms: Evaluating how these agents generalize cooperative skills to entirely novel partners and scenarios requires specialized frameworks like Concordia, developed by Chandler Smith et al. in Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordia.
Granular Diagnostics and Observability
Because agentic failures are systemic and multi-causal, simple binary success/fail metrics are no longer sufficient. If an agent fails to complete a software engineering task, did it fail because it misunderstood the goal, hallucinated an API call, or lost track of its history due to a long context window?
Luca Gioacchini et al. argue in AgentQuest: A Modular Benchmark Framework to Measure Progress and Improve LLM Agents that benchmarks must provide nuanced, modular tracking to diagnose specific failure modes rather than relying on a single success rate.
This need for deep observability is especially critical for safety and security. Traditional safety evaluations test single-turn prompts for harmful content, but Ilham Wicaksono et al. demonstrate in Mind the Gap: Evaluating Model- and Agentic-Level Vulnerabilities in LLMs with Action Graphs that critical vulnerabilities often emerge exclusively through multi-step tool usage. By mapping agent executions as action graphs, they highlight a massive gap between model-level security and agentic-level security. An agent can be exploited through its environment interactions even if the underlying model passes standard, static safety filters.
Ultimately, moving beyond static benchmarks allows the research community to see exactly why an agent succeeds or fails, paving the way for architectures that can reliably plan, execute, and cooperate over long horizons.