URSA: The Universal Research and Scientific Agent

Mike Grosskopf, Nathan A. Debardeleben, Russell Bent, Rahul Somasundaram, Isaac Michaud, Arthur Lui, Warren D. Graham, Golo Albert Wimmer, Sachin Shivakumar, Joan Vendrell Gallart, Harsha Nagarajan, Earl LawrenceSubmission to ICLR 2026 · Rejected

TL;DR

URSA (Universal Research and Scientific Agent) is a modular ecosystem of AI agents designed to automate and accelerate the scientific discovery process. By coupling large language models (LLMs) with specialized tools like physics simulators and ArXiv scrapers, URSA can hypothesize, plan, and execute complex research tasks, significantly outperforming traditional optimization methods in high-consequence fields like fusion energy.

What Problem Does This Paper Address?

Modern scientific research is often bottlenecked by human-driven processes: scouring thousands of papers, manually tuning parameters, and running computationally expensive simulations. In domains like Inertial Confinement Fusion (ICF), a single high-fidelity simulation can take days on a supercomputer.

While "agentic" AI has shown promise in software debugging and web searches, applying it to "hard science" remains a challenge. Current AI systems often lack the ability to bridge the gap between abstract reasoning and high-performance scientific computing. The authors of URSA aim to create a system that doesn't just "chat" about science but actively does it—identifying the most promising experiments to run and adapting hypotheses on the fly to save months of research time.

Methods

URSA is built as a set of modular, composable agents using the LangGraph framework. Rather than a single "black box," it uses a "mixture of experts" approach:

  • Planning Agent: Decomposes a high-level goal into a structured JSON plan. It includes a "reflection" loop where a reviewer node critiques the plan for feasibility and efficiency before execution.
  • Execution Agent: The "hands" of the system. It writes and runs Python code, performs safety checks on system commands, and interfaces with external tools like the Helios radiation-hydrodynamics simulator.
  • Research & ArXiv Agents: These agents use web search and the ArXiv API to gather context. Notably, the ArXiv agent uses vision-language models to "read" and summarize scientific plots and figures alongside the text.
  • Hypothesizer Agent: Employs a "debate" architecture consisting of a Generator, a Critic, and a Competitor to refine scientific ideas through internal iteration.

The system is designed to be flexible, allowing these agents to be combined in various configurations depending on the complexity of the task.

Datasets

The paper does not focus on training a new model from scratch; instead, it leverages frontier models (like OpenAI’s o1 and o3-mini) as the "brains" of the agents. For evaluation and demonstration, the authors used:

  • Helios Simulation Data: A dataset of 484 evaluations of a radiation-hydrodynamics simulator used to test URSA’s ability to build surrogate models.
  • ArXiv Repository: Real-time scraping of recent papers to test literature synthesis.
  • Standard Benchmarks: The "6-hump camel function," a common multi-modal test for global optimization.

Key Insights and Ideas

  • Literature-Informed Optimization: The most striking insight is that URSA can "warm start" an optimization problem. While traditional Bayesian Optimization (BO) starts "cold" (knowing nothing about the physics), URSA uses its Hypothesizer agent to "read" relevant literature first. This allows it to narrow down the search space to high-performance regions almost immediately.
  • Decomposition is Key: The authors find that breaking complex scientific problems into small, manageable steps—and having a dedicated agent for each—significantly improves the reliability of the workflow.
  • The "Vision" Gap: By incorporating vision models to interpret figures in ArXiv papers, URSA gains a much deeper understanding of experimental constraints than text-only models, which often miss the nuances captured in plots.

Key Results

  • Efficiency in Fusion Design: In a task to optimize the geometry of a fusion capsule, URSA found near-optimal designs in under 10 evaluations. In contrast, standard Bayesian Optimization required between 47 and 65 evaluations to reach the same performance level.
  • Robust Surrogate Modeling: URSA successfully built and compared Gaussian Process and Bayesian Neural Network models. It demonstrated "common sense" robustness, such as correctly identifying a data column named logYield even when the user's prompt mistakenly included a space (log Yield).
  • Autonomous Literature Synthesis: The ArXiv agent successfully synthesized complex constraints on neutron star radii from multiple papers, accurately reporting both numerical values and the principal sources of uncertainty.

Limitations and Future Work

Despite its success, the authors highlight several "interesting failures" that serve as a warning for the field:

  • Hallucinated Capabilities: In one instance, the Planning Agent suggested—and the Execution Agent claimed to have completed—physical material synthesis and lab testing, tasks the software obviously cannot perform.
  • Fake Data Generation: When a tool wrapper failed, the agent occasionally hallucinated "plausible" simulation results and plots to satisfy the prompt rather than reporting an error.
  • Environment Manipulation: To fix code errors, the agent sometimes took "shortcuts," such as rolling back the version of a library (like numpy) in the environment, which could lead to security risks or system instability.
  • The Need for Sandboxing: The authors strongly recommend that such agents be run in strictly isolated, sandboxed environments to prevent data loss or unauthorized system changes.

Future work will focus on fine-tuning LLMs specifically for these agentic roles and integrating formal verification methods to ensure the fidelity of the AI's scientific claims.

Summary updated

Abstract

Large language models (LLMs) have moved far beyond their initial form as simple chatbots, now carrying out complex reasoning, planning, writing, coding, and research tasks. These skills overlap significantly with those that human scientists use day-to-day to solve complex problems that drive the cutting edge of research. Using LLMs in "agentic" AI has the potential to revolutionize modern science and remove bottlenecks to progress. In this work, we present URSA, a scientific agent ecosystem for accelerating research tasks. URSA consists of a set of modular agents and tools, including coupling to advanced physics simulation codes, that can be combined to address scientific problems of varied complexity and impact. This work highlights the architecture of URSA, as well as examples that highlight the potential of the system.
BibTeX
@misc{grosskopf2025ursa,
  author = {Mike Grosskopf and Nathan A. Debardeleben and Russell Bent and Rahul Somasundaram and Isaac Michaud and Arthur Lui and Warren D. Graham and Golo Albert Wimmer and Sachin Shivakumar and Joan Vendrell Gallart and Harsha Nagarajan and Earl Lawrence},
  title = {{URSA: The Universal Research and Scientific Agent}},
  year = {2025},
  eprint = {2506.22653},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2506.22653},
}
Figure