A Reinforcement Learning Method to Navigate SMEFT Operator Space

Jacky KumararXiv 2026 · arXiv

TL;DR

Researchers have developed a reinforcement learning (RL) framework to navigate the massive combinatorial "haystack" of possible new physics models. By treating the search for theoretical operators as a sequential game, the RL agent discovers diverse sets of high-quality hypotheses that explain experimental anomalies far more efficiently than traditional random searches.

What Problem Does This Paper Address?

In particle physics, the Standard Model (SM) is remarkably successful but leaves big questions unanswered, like the nature of dark matter or neutrino masses. Physicists look for "New Physics" (NP) using the Standard Model Effective Field Theory (SMEFT), a framework that adds new mathematical operators to the SM to account for potential high-energy interactions.

The challenge is the scale: at the "dimension-six" level, there are 2,499 independent operators. Finding which combination of these operators explains experimental discrepancies (anomalies) is a nightmare. Operators are highly correlated—one operator might fix a discrepancy in B-meson decays but ruin the agreement in Higgs measurements. Exhaustively testing every combination is computationally impossible, and human intuition often limits the search to a tiny fraction of the space.

Methods

The author formulates this as a sequential decision-making problem. Instead of picking a whole theory at once, an RL agent builds a theory one operator at a time.

  • The Agent: A lightweight "actor-critic" neural network based on a Transformer architecture. It has only 40,000 parameters, making it efficient enough to run on standard CPUs.
  • The Reward: The agent isn't just looking for the single "best" fit. It uses a quality-diversity reward. It gets points for improving the global fit (reducing $\chi^2$) and for finding "novel" solutions that are structurally different from ones it has already found (measured using the Jaccard similarity index).
  • The Environment: To make training feasible, the author precomputed semi-analytic expressions for 132 observables. This bypasses the need to perform expensive Renormalization Group (RG) evolution calculations every time the agent tries a new operator.

Datasets

The study uses a complex benchmark environment consisting of 132 observables across various sectors: electroweak precision, B- and K-meson processes, Higgs physics, and more.

Within this set, the author identified 24 "anomalies"—measurements that deviate from SM predictions by more than 1.5$\sigma$. This creates a challenging "landscape" where the agent must find operators that address these specific deviations without violating the constraints imposed by the other 108 measurements.

Table 1: The 24 anomalies used in the benchmark dataset, showing the "pull" (deviation) from the Standard Model.

Key Insights and Ideas

  • Conditional Learning: The RL agent doesn't just learn a global ranking of "good" operators. It learns conditional preferences. It might learn that if Operator A is already in the theory, Operator B becomes highly desirable because it "repairs" a side-effect caused by Operator A.
  • Beyond Optimization: Most physics fits aim for the single best point in parameter space. This paper argues that identifying the degeneracy—the many different ways to explain the same data—is more important for model building.
  • Efficiency: The RL policy discovered high-quality solutions (improving the fit by $\Delta\chi^2 > 100$) significantly faster and more reliably than random-subset or random-sequential baselines.

Key Results

  • Discovery of Families: The agent identified 26 distinct "families" of solutions. These are groups of operator sets that provide excellent fits to the data but are structurally different from one another.
  • Performance: In a head-to-head comparison, the RL agent found over 140 unique high-quality solutions, while random sequential searches found almost none in the same timeframe.
  • Scaling: By combining results from 10 independent training runs (different "seeds"), the researchers showed that the method continues to uncover new regions of the operator space rather than getting stuck in a single local optimum.

Limitations and Future Work

  • Linear Approximation: For this initial work, the author focused on the linear contributions of the operators. While SMEFT often involves quadratic terms, the linear approximation is a standard starting point. The author notes the RL framework can be extended to include quadratic terms.
  • Fixed Complexity: The trajectories were limited to a maximum of 10 operators ($T=10$). Future work could explore more complex theories or allow the agent to decide when a theory is "complete."
  • Amortization: A promising next step is "amortized inference"—training an agent on a wide variety of anomaly patterns so it can instantly propose candidates for new experimental results without needing to be retrained from scratch.

The code for this project is available as an open-source Python package called ReinforceSMEFT.

Summary updated

Abstract

In particle physics, discrepancies between experimental measurements and Standard Model (SM) predictions are commonly interpreted within new theoretical models. In this context, the Standard Model Effective Field Theory (SMEFT) provides a general framework encompassing a broad class of models. However, exploring the enormous space of possible SMEFT operators rapidly becomes a challenging combinatorial problem: many operators can contribute simultaneously to different observables, their effects are correlated, and distinct operator combinations can provide comparably good descriptions of the data. In this work, we formulate the exploration of the SMEFT operator space as a sequential decision-making problem using reinforcement learning (RL). Our RL agent employs a lightweight actor-critic architecture with approximately 40K trainable parameters in total. Rather than searching for a single best-fit theory, our method is designed to discover a diverse set of high-quality theory hypotheses. We test the method in a complex phenomenological environment comprising 132 observables across several sectors of particle physics, including 24 measurements that deviate from their SM predictions by more than $1.5σ$. We show that the learned RL policy efficiently constructs multi-operator theories that substantially improve the global fit. Comparisons with independent random-subset and random-sequential searches demonstrate the ability of the RL policy to navigate this large combinatorial space. Our results establish RL as a systematic framework for exploring diverse patterns of new physics (NP) interactions within SMEFT.
BibTeX
@misc{kumar2026reinforcement,
  author = {Jacky Kumar},
  title = {{A Reinforcement Learning Method to Navigate SMEFT Operator Space}},
  year = {2026},
  eprint = {2611.21439},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.21439},
}
Figure