TL;DR
Just because an AI agent's score goes up doesn't mean it's actually getting smarter. This paper introduces a rigorous "Artifact-to-Capability" diagnostic framework to prove that standard performance metrics often mask fundamental failures in how self-evolving agents learn and reuse skills.
What Problem Does This Paper Address?
We are currently in an era of "self-evolving" agents—AI systems that learn from their own experiences by creating "artifacts" like textual reflections, code snippets, or skill libraries. Usually, researchers claim these agents are successful if they see three "proxy signals": they generate more artifacts, their behavior changes when those artifacts are loaded, and their overall task scores improve.
The authors argue that these signals are deceptive. A higher score might come from an agent simply learning to follow basic rules (like not playing on an occupied square) rather than actually getting better at the core task (like winning the game). To fix this, the paper defines what it actually means for an artifact to become a capability and provides a way to "microscope" the evolution process to find exactly where it breaks.
Methods
The researchers propose the Artifact-to-Capability framework, which decomposes capability formation into a "capability chain" of five sequentially dependent properties:
- Artifact formation: A persistent structure (like a code file) is created.
- Behavioral activation: The artifact actually changes the agent's actions.
- Task-relation realization: The change is positive and advances the task objective.
- Boundary-safe reuse: The new skill doesn't break existing ones when combined.
- Capability extension: Later versions of the agent build upon and preserve these gains.
They test this using freestyle Gomoku (Five-in-a-Row) as a controlled environment. Gomoku is ideal because it has simple, absolute rules, yet requires complex spatial reasoning that is difficult for LLMs (see Figure 1). Crucially, it allows for "replayable states," meaning researchers can test an agent with and without a specific memory on the exact same board position to see what changed.
Datasets
The study uses freestyle Gomoku with a 15x15 board. Evaluation is performed on 1,876 fixed board states:
- Set A: 120 manually constructed tactical states (e.g., immediate win opportunities).
- Set B: 1,756 states drawn from actual games played during the evolution of one of the agents.
The agents are tested against three programmatic opponents of increasing difficulty: rule-based, threat-aware, and search_2.
Key Insights and Ideas
The "aha moment" of the paper is the discovery of three distinct types of "capability-formation breaks" in popular agent frameworks:
- Legalization Gain (Reflexion): The agent's score rose, but only because it learned to stop making illegal moves. When looking only at its legal move choices, the agent actually performed worse after "reflecting" on its mistakes.
- Compositional Override (Voyager): Individual skills worked fine in isolation, but the "calling script" that managed them was flawed. In "conflict states"—where both the agent and the opponent could win in one move—the agent's defensive skill would trigger and block the opponent, completely ignoring its own immediate chance to win the game.
- Loss-Only Drift (DGM): While the agent initially formed a capability, later generations of the "evolving" code stopped adding new skills and actually began losing the ones they had already mastered, despite the internal evolutionary scores remaining high.
Key Results
The authors diagnosed three well-known self-evolution mechanisms and found that while all showed "positive" signals, all failed the capability chain:
- Reflexion: While the overall pass rate rose, the legal pass rate (the quality of legal moves) dropped by 1.6–4.4 percentage points on the large test set.
- Voyager: Despite forming "open fours" (a strong offensive position) in every game, it failed to complete a win in 0 out of 20 immediate-win opportunities during actual gameplay due to the compositional override.
- DGM: After reaching a peak version (OB-3), subsequent versions (OB-5, OB-6) added zero newly passing states and only lost existing ones, a phenomenon the authors call "loss-only drift."
Limitations and Future Work
The primary limitation is the environment: freestyle Gomoku is a discrete, rule-governed game. While this "microscope" is powerful for identifying logic breaks, it's unclear how these properties translate to open-ended, unstructured tasks (like writing a novel or browsing the web) where "correctness" is subjective and states are harder to replay exactly.
The authors suggest that future work should focus on operationalizing this framework for more complex, real-world agent tasks to ensure that "self-evolution" is resulting in genuine, robust capabilities rather than just metric-chasing.
Summary updated