Counterexample-driven autonomous research with application to excess radiated energy in a Z-pinch

Bowen Zhu, Jian WuarXiv 2026 · arXiv

TL;DR

Simjecture is a new open-source framework that enables LLM agents to conduct autonomous physics research by systematically falsifying and repairing human-defined conjectures. By separating numerical "instrument" qualification from scientific hypothesis testing, the system successfully investigated the long-standing mystery of excess radiation in Z-pinch plasmas, discovering how helical instabilities and trailing plasma govern energy conversion.

What Problem Does This Paper Address?

While AI has recently made waves in pure mathematics by finding counterexamples to long-standing conjectures, translating this success to physics is notoriously difficult. Physics is empirical; no model is ever "final," and every discovery is tethered to the reliability of the instruments used to observe it.

In computational physics, this creates a "duality" problem: if a simulation contradicts a theory, is it because the theory is wrong (a scientific discovery) or because the simulation's mesh was too coarse (a numerical error)? The authors address this by creating a framework that mimics a professional research team, specifically targeting the "excess radiated energy" problem in Z-pinch physics—where the X-rays emitted by a collapsing plasma column far exceed the kinetic energy of the collapse itself.

Methods

The authors introduce Simjecture, a multi-agent framework comprising three primary roles:

  • The Director: Manages the high-level strategy, budget, and human-in-the-loop steering.
  • The Worker: An autonomous agent (using models like DeepSeek Flash) that writes code, configures simulations (using the FLASH and WarpX codes), and analyzes raw multi-dimensional data.
  • The Reviewer: An independent auditor (using GPT-6.1 Sol) that must "qualify" the numerical setup before any scientific claim is accepted.

The core innovation is the coupled workflow (see Figure 1). The system treats the simulation code as an "executable instrument" that must pass convergence and calibration tests (the orange path) before its results can be used to falsify or support a physical hypothesis (the teal path).

FIG. 1. Coupled scientific (teal) and instrument (orange) workflows in Simjecture.

Datasets

The paper does not use a static training dataset in the traditional machine learning sense. Instead, it uses:

  • Computational Testbeds: The FLASH (radiation-MHD) and WarpX (particle-in-cell) simulation frameworks.
  • Validation Case: A 2D magnetic island coalescence study used to verify the agent's ability to scale reconnection rates.
  • Main Study: A 3D investigation of an 8-wire aluminum Z-pinch based on parameters from the 1 MA Zebra pulsed-power generator.
  • Benchmark Potential: The authors propose that their recorded 82.6-hour "investigation history" (1,048 executions) serves as a new kind of benchmark for evaluating the scientific reasoning of future AI agents.

Key Insights and Ideas

  • Counterexample-Driven Research: Rather than trying to "prove" a theory, the AI searches for specific configurations that break it. This "minimal repair" cycle forces the AI to find the smallest scientifically justified change to a theory to make it fit the data.
  • The "Instrument" vs. "Science" Split: By forcing an independent "Methods Review," the framework prevents agents from "gaming" a simulation to get a desired result through numerical artifacts.
  • Z-Pinch Energy Dynamics: The AI discovered that stronger helical kinking (m=1 instabilities) actually reduces total radiation. While it increases resistive heating, it weakens the radial compression necessary for efficient X-ray production.
  • Trailing Plasma Shunting: The AI found that a broader profile of "trailing plasma" (mass left behind during the collapse) shunts current away from the core, delaying the radiation pulse but allowing for a "catch-up" phase later in the stagnation.

Key Results

  • Reconnection Scaling: In the validation study, the agent successfully falsified the standard Sweet-Parker scaling conjecture, finding a local scaling exponent of $p_{eff} = -0.3778$ (Figure 2g).
  • 82.6-Hour Autonomous Campaign: The system managed over 1,000 computational executions with an 80% success rate, requiring only four human "steering" interventions to redirect the inquiry when the agents got stuck on simple proxies.
  • Energy Accounting: The investigation revealed that non-axisymmetric Ohmic heating accounts for approximately 12.55% of the radiation excess above the kinetic energy reference.
  • Radiation Recovery: Broadening the trailing plasma profile delayed the radiation peak by ~5 ns but recovered 60% of the initial energy deficit by the end of the pulse (Figure 7).
Campaign Progression

Limitations and Future Work

  • Agent "Taste": The authors noted that without human steering, agents tended to narrow their focus to simple variables or stop prematurely. "Scientific taste"—knowing which questions are worth asking—remains a human-led requirement.
  • Token Intensity: The 82.6-hour run consumed nearly 1 billion input tokens. To improve efficiency, the authors integrated a smaller 4B-parameter "decision policy" model to handle routine status monitoring.
  • Scaling Up: Future work involves extending Simjecture to other complex physics domains (like fluid dynamics or materials science) and improving the agents' ability to handle "stalled" solver stages without wasting compute budget.

Summary updated

Abstract

Recent breakthroughs in artificial-intelligence-assisted mathematics show that open-ended machine search can outperform human mathematicians, yet transferring this paradigm to physics requires refactoring the research workflow. We introduce Simjecture, an open-source framework in which language-model agents pursue human-defined physical conjectures. The framework tackles two central challenges in this transfer: first, because physics is empirical and no model is final, it structures inquiry around counterexample-driven falsification and prospective hypothesis repair; second, because physical theories must interact with the real world, it uses computational physics as an executable testbed while separating the qualification of numerical instruments from scientific claim review so solvers and diagnostics can be adapted within a recorded investigation. We apply the framework in an 82.6 h investigation to tackle the long-standing problem of radiated energy exceeding the imploding-shell kinetic energy in a Z-pinch. The investigation reveals competing effects of energy conversion, retention, and release timing. Stronger coherent helical deformation increases resistive conversion while reducing radiation and increasing retained energy. A broader trailing-plasma profile delays the later radiation maximum and recovers much of its early bolometric deficit, with a spectral response that changes during the pulse. These results provide new insight into energy conversion in high-energy-density plasma physics and demonstrate a new paradigm for physics research.
BibTeX
@misc{zhu2026counterexample,
  author = {Bowen Zhu and Jian Wu},
  title = {{Counterexample-driven autonomous research with application to excess radiated energy in a Z-pinch}},
  year = {2026},
  eprint = {2611.03721},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.03721},
}
Figure