STaSBO: LLM-Guided Strategy Planning and Configuration Selection for Bayesian Optimization

Youngseok Yoon, Peng LiarXiv 2026 · arXiv

TL;DR

STaSBO introduces a hybrid "meta-controller" for Bayesian Optimization (BO) that uses a Large Language Model (LLM) to plan high-level search strategies while leaving the heavy mathematical lifting to traditional numerical solvers. By separating strategic intent from candidate generation, it achieves state-of-the-art performance across diverse scientific and engineering tasks without needing problem-specific tuning.

What Problem Does This Paper Address?

Bayesian Optimization is the gold standard for finding the "best" settings in expensive, black-box scenarios—like discovering a new chemical formula or tuning a robot's gait. However, BO is notoriously sensitive to its configuration: you must choose a surrogate model (to guess what the function looks like) and an acquisition function (to decide where to sample next).

The "perfect" configuration changes depending on the problem and even the stage of the search (e.g., exploring broadly at the start vs. refining a local peak at the end). Most researchers either use a fixed "safe" configuration or try to meta-learn one from previous tasks. The former is often suboptimal, and the latter requires a massive dataset of related problems. Recent attempts to use LLMs for BO often try to have the model suggest points directly, which ignores decades of robust numerical optimization research.

Methods

The authors propose STaSBO (Strategy-guided Task-agnostic adaptive Selection for BO). It treats the LLM as a high-level manager and the numerical BO as a specialized technician. The process happens in two coordinated stages:

  1. Strategy Planning: The LLM looks at a "decision-aware memory" (search history, previous plans, and outcomes). It doesn't pick a point; it picks an intent. For example: "We found a good area; let's refine it," or "We are stuck in a local optimum; let's explore a distant, uncertain region."
  2. Strategy-Guided Configuration Selection:
    • Shortlisting: Based on the intent, the LLM selects a few promising surrogate-acquisition pairs. It uses "surrogate fit evidence" (numerical stats like length scales) to see which models actually fit the current data well.
  3. Joint Selection: The numerical BO generates prospective points for each shortlisted configuration. The LLM then looks at "diagnostics" for these points (e.g., "How far is this from the current best?") and picks the configuration whose proposed point best matches the high-level plan.

This "look-ahead" mechanism ensures the LLM isn't just guessing; it sees exactly what the math is proposing before committing to an evaluation.

Datasets

The authors evaluated STaSBO against 11 baselines (including TuRBO, CAKE, and LMABO) across 22 diverse tasks:

  • 12 Synthetic Benchmarks: Classic mathematical functions like Ackley, Levy, and Rastrigin, tested in 5D, 8D, and 15D spaces.
  • 10 Real-World Applications: These include optimizing concrete compressive strength, nanomaterials synthesis (AgNP), functional materials (P3HT), analytical chemistry (HPLC), and electrocatalysis (OER Plate).
  • Control Simulation: The "Lunar Lander" environment, where the goal is to optimize a controller for a smooth landing.

Key Insights and Ideas

  • Intent vs. Outcome: A key "aha" moment is the use of a memory system that tracks whether an intended behavior was realized, regardless of whether the score improved. If the plan was to "explore" and the point was indeed far away but had a poor score, the LLM knows the strategy worked as intended, even if the result wasn't a new "best."
  • LLMs as Meta-Controllers: The paper argues that LLMs shouldn't do the math; they should do the reasoning. By providing the LLM with numerical diagnostics (distances, fit statistics) rather than raw data tables, the authors ground the model's reasoning in reality.
  • Joint Adaptation: Most adaptive BO methods only change the acquisition function. STaSBO shows that jointly selecting the surrogate and acquisition function is vital because their behaviors are deeply coupled.
  • Task-Agnosticism: Because the LLM reasons about the process of optimization (exploration vs. exploitation) rather than the specific physics of the problem, the same controller works across chemistry, engineering, and math.

Key Results

  • Superior Ranking: STaSBO achieved an average rank of 2.17 on synthetic tasks and 2.60 on application tasks. For comparison, the strongest traditional baselines scored around 4.08 and 4.10, respectively.
  • Sample Efficiency: STaSBO reached target performance levels significantly faster, requiring 22% to 32% fewer iterations than the best-performing baselines.
  • Finding "Rare" Solutions: Using a "rarity" metric (the probability of finding a point that good by random sampling), STaSBO found solutions that were 5.79x rarer (better) than those found by TuRBO, the strongest baseline.

Limitations and Future Work

  • LLM Overhead: While the cost of an LLM API call is trivial compared to a $1,000 physical lab experiment, it might be overkill for cheap, fast-to-evaluate computer simulations.
  • Context Window Limits: The current system uses a "bounded view" of recent history. For extremely long optimization runs (hundreds of iterations), more sophisticated long-term memory management might be needed.
  • Library Constraints: STaSBO selects from a predefined (though broad) library of surrogate and acquisition profiles. Future work could allow the LLM to "code" or compose entirely new kernels or acquisition functions on the fly.
  • Safety and Constraints: While the paper touches on OER simplex constraints, more complex "safety-critical" constraints (where certain areas of the search space must be avoided at all costs) remain an area for further development.

Summary updated

Abstract

Bayesian optimization (BO) enables sample-efficient search for expensive black-box problems, but its performance depends strongly on surrogate-acquisition configurations whose suitability varies across problems and optimization states. We take a significant step toward LLM-driven strategic management of BO with STaSBO, a task-agnostic meta-controller that plans search behavior and jointly selects surrogate-acquisition configurations, while numerical BO retains responsibility for probabilistic modeling and candidate generation. STaSBO comprises two coordinated stages: strategy planning and strategy-guided configuration selection. A structured memory system connects prior plans, configuration selections, and candidate behaviors to optimization states, allowing the controller to revise its trajectory summary and behavioral plans during planning. To navigate the large joint configuration space, the selection stage shortlists configurations using surrogate fit evidence. Prospective BO-action diagnostics then expose the candidate behaviors, supporting final joint selection against the behavioral plans. Across 12 synthetic mathematical and 10 scientific and engineering application tasks, STaSBO achieves the best average rank against 11 baselines: 2.17 and 2.60, compared with 4.08 and 4.10 for the strongest baseline in each suite, respectively.
BibTeX
@misc{yoon2026stasbo,
  author = {Youngseok Yoon and Peng Li},
  title = {{STaSBO: LLM-Guided Strategy Planning and Configuration Selection for Bayesian Optimization}},
  year = {2026},
  eprint = {2611.19214},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.19214},
}
Figure