Verifiable pXRD: Hill-climbing pXRD structure determination with LLM agents

Samuel Chen, Jiaru Bai, Austin Henry Cheng, Varinia Bernales, Alán Aspuru-GuzikarXiv 2026 · arXiv

TL;DR

This paper introduces a framework for autonomous crystal structure determination from powder X-ray diffraction (pXRD) data using LLM agents. By treating structure determination as a "verifiable agentic search" and using a "reflexive evolution" process to learn from synthetic data, the authors demonstrate a jump in structural recovery from 27% to 69% on a new 200-problem benchmark.

What Problem Does This Paper Address?

In the quest for "self-driving" materials laboratories, autonomous characterization is a major bottleneck. Powder X-ray diffraction (pXRD) is the workhorse of materials science, but interpreting its patterns is a complex inverse problem. You start with a 1D intensity profile and must infer a 3D atomic arrangement.

Standard approaches often rely on one-shot generative models or rigid algorithmic searches, which struggle with "out-of-distribution" structures (things the model hasn't seen before) or complex multiphase mixtures. The authors argue that structure determination is naturally an adaptive, iterative process—much like how a human crystallographer works—and that LLM agents are uniquely suited to navigate this "hill-climbing" task if given the right tools and feedback loops.

Methods

The authors formulate pXRD analysis as a verifiable agentic search. The core idea is that while finding the structure is hard, verifying a candidate is relatively easy via forward simulation (calculating what the diffraction pattern should look like for a proposed structure).

Key components of their approach include:

  • Agent Adaptation Ladder: They tested agents with increasing levels of capability, moving from tool-free reasoning to matsci-codex (Python + database access) and finally pxrd-codex (access to specialized software like GSAS-II and DICVOL).
  • Reflexive Evolution: To bridge the gap between simulation and experiment, they used a "trainer" agent to watch a "trainee" agent fail on synthetic problems. The trainer then distilled these failures into a capability package—a set of natural language instructions and helper tools—that the agent could use on real experimental data.
  • Inference-Time Scaling: They leveraged the verifiability of the task by generating multiple independent solution attempts (rollouts) and using an LLM-based "judge" to decide whether to stop or continue searching.
Figure 1: pXRD structure determination as a verifiable inverse problem. Ground truth: pXRD-Bench case pxrd100-rep-010. Proposed: pxrd-codex selected.cif. Structures rendered with Crystal Toolkit [Horton et al., 2023].

Datasets

The study utilizes two primary datasets:

  1. pXRD-Bench: A new suite of 200 simulated single-phase problems. It includes pXRD-100 (in-distribution structures from the Materials Project) and pXRD-ood (out-of-distribution cases designed to test compositional and topological extrapolation).
  2. divalent-tungstates-PG15: A set of 15 experimental multiphase patterns from the Precursor Genome project, representing real-world solid-state synthesis results.

Key Insights and Ideas

  • Verifiability is the "Secret Sauce": Because agents can simulate the diffraction pattern of their proposed structure and compare it to the input (calculating the $R_{wp}$ residual), they have a clear objective for hill-climbing without needing the ground-truth answer.
  • LLMs as Orchestrators: The LLM doesn't need to "know" the structure instantly. Instead, it acts as a scientist, using DICVOL for indexing, GSAS-II for Rietveld refinement, and databases for prototype searching.
  • Learning from Synthetic Failures: The "reflexive evolution" framework allows agents to develop sophisticated strategies—like analogue substitution (swapping atoms in a known structure to match a new composition)—by practicing on synthetic data where the ground truth is known.
  • Compute-to-Performance Scaling: Performance scales significantly with "test-time compute." By sampling 8 independent trajectories, the agent's chance of finding the correct structure increases dramatically.
Inference-time scaling results showing how repeated sampling improves recovery.

Key Results

  • Benchmark Performance: The adapted-codex agent achieved a 69% exact structural recovery on pXRD-Bench, compared to only 27% for a tool-free frontier LLM.
  • Experimental Success: On real experimental patterns, the evolved agent reduced the mean profile residual from 7.90% to 6.71%.
  • Discovery of "Missing" Phases: In a standout result, the agent successfully recovered the structure of $Sr_2WO_5$ in an experimental mixture, even though that specific structure was entirely absent from its reference library. It achieved this by autonomously substituting atoms into a $Ba_2ReO_5$ prototype it found via its learned search tools.

Limitations and Future Work

  • Stochasticity: LLM agents are still prone to "rollout variability," where the same agent might succeed or fail on the same problem due to the probabilistic nature of the model.
  • Refinement Complexity: While agents are good at finding the right "neighborhood" of a structure, fine-tuning atomic positions in complex multiphase samples remains challenging.
  • Generalization Limits: The authors noted that guidance evolved for one family of materials (like tungstates) might not perfectly transfer to entirely different chemical systems without further "evolution" cycles.
  • Future Directions: The authors suggest moving toward more involved reflective optimizers and potentially using these verifiable trajectories to fine-tune the underlying models directly.

Summary updated

Abstract

Autonomous crystal-structure determination from powder X-ray diffraction (pXRD) remains a key bottleneck for self-driving materials laboratories. We formulate the task of pXRD structure determination as a verifiable agentic search problem: candidate structures can be assessed during inference through forward-simulated profile agreement and during evaluation through structural matching to a known reference. To benchmark progress, we introduce pXRD-Bench, a suite of 200 simulated single-phase problems spanning in-distribution structure determination, challenging and polymorphic structures, and controlled compositional and topological distribution shifts. Agent adaptation raises selected structural recovery from 27% to 69%, with further gains from repeated sampling and verifier-guided inference-time scaling. We extend this approach to experimental multiphase pXRD through a reflexive evolution framework that learns from self-generated synthetic problems. A replaceable laboratory specification defines the sample family and measurement conditions. An evolver agent uses the known generating structures and measurement parameters to diagnose solver failures and develop persistent guidance and executable tools, which are then provided to agents on measured patterns. This supplies verifiable training experience without requiring a collection of solved experimental measurements. On 15 measured patterns from solid-state synthesis, the evolved package improves average profile agreement and transfers an analogue-substitution procedure that recovers a phase whose structure is absent from the supplied reference library. These results demonstrate how learning from verifiable synthetic experience can improve agentic characterization of experimental samples whose structures are not known in advance.
BibTeX
@misc{chen2026verifiable,
  author = {Samuel Chen and Jiaru Bai and Austin Henry Cheng and Varinia Bernales and Alán Aspuru-Guzik},
  title = {{Verifiable pXRD: Hill-climbing pXRD structure determination with LLM agents}},
  year = {2026},
  eprint = {2611.17539},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.17539},
}
Figure