Safe learning-based control via function-based uncertainty quantification

Abdullah Tokmak, Toni Karvonen, Thomas B. Schön, Dominik BaumannarXiv 2026 · arXiv

TL;DR

This paper introduces a flexible, data-driven framework for uncertainty quantification (UQ) in safe learning-based control that ditches restrictive assumptions like known Lipschitz constants or RKHS norm bounds. By leveraging the scenario approach to sample data-consistent function realizations, the authors construct robust "uncertainty tubes" and demonstrate zero-violation safety tuning on a real-world Furuta pendulum.

What Problem Does This Paper Address?

When deploying learning-based controllers (like reinforcement learning) in safety-critical, real-world systems, we cannot afford a "trial and error" phase that breaks the hardware. Safe Bayesian Optimization (BO) algorithms like SAFEOPT solve this by constructing probabilistic "uncertainty tubes" around unknown reward and constraint functions, ensuring the system only experiments within a verified safe parameter space.

However, existing UQ methods suffer from a major practicality gap: they typically require users to know strict analytical properties of the system, such as a tight upper bound on the Reproducing Kernel Hilbert Space (RKHS) norm or the exact Lipschitz constant. In practice, these constants are notoriously difficult to estimate. Furthermore, standard Gaussian Process (GP) models struggle to capture sharp discontinuities. This paper addresses these limitations by replacing rigid analytical bounds with a purely data-driven sampling approach.

Methods

The authors propose Function-Based Uncertainty Quantification, which models the unknown system functions using a finite linear expansion of user-chosen basis functions with random coefficients:

$$hi(a) = \sum_{r=1}^N ci,r \phi_{i,r}(a)$$

This formulation is highly flexible; by choosing different bases (e.g., Haar wavelets), it can naturally accommodate discontinuous or heavy-tailed behaviors that frustrate traditional GP methods.

To build the uncertainty tubes without knowing Lipschitz constants, the authors turn to the scenario approach—a data-driven decision-making tool. The process works as follows:

  1. Scenario Generation: They sample independent and identically distributed (i.i.d.) random function realizations ("scenarios") from the prior distribution and project them to match the observed experimental data.
  2. Tube Construction: They solve a convex optimization problem to find the tightest pointwise upper and lower bounds that enclose all generated scenarios.
  3. Wait-and-Judge Optimization: Instead of using the conservative classic scenario approach, they implement a "wait-and-judge" framework (Algorithm 1). This evaluates the number of support scenarios (the essential samples defining the boundaries) a posteriori, drastically reducing the number of samples needed to guarantee safety.

Finally, they integrate these tubes into a safe BO loop (Algorithm 2) to iteratively expand the safe set and optimize controller parameters.

Datasets

The method was evaluated using synthetic benchmarks and real-world hardware rather than standard static datasets:

  • Synthetic 1D Optimization Benchmark: Used to compare the efficiency of the classic scenario approach against the wait-and-judge framework.
  • Haar Wavelet Discontinuous Benchmark: A synthetic test demonstrating UQ on a highly non-smooth function.
  • Physical Hardware: Experimental validation on a real Quanser Furuta Pendulum (QUBE-Servo 2) setup to safely tune a linear state-feedback controller.

Key Insights and Ideas

  • Sampling Over Analytical Bounding: Instead of trying to mathematically bound the worst-case behavior of an abstract function space, the method simply asks: "What do valid, data-consistent realizations of this system look like?" Pointwise minimization and maximization over these samples yield valid probabilistic bounds.
  • The Power of "Wait-and-Judge": The classic scenario approach suffers from the curse of dimensionality because sample size requirements scale with the discretization of the domain. By switching to a wait-and-judge approach, the algorithm dynamically checks if the collected tubes are tight enough, reducing sample complexity by orders of magnitude.
  • Discontinuity-Friendliness: Because the framework accepts arbitrary basis functions, it can seamlessly handle non-smooth systems (e.g., friction thresholds or hard obstacles) by utilizing wavelets instead of smooth squared-exponential kernels.

Key Results

  • Massive Sample Reduction: In a synthetic 1000-point discretization test, the classic scenario approach required 21,403 scenarios to guarantee the target confidence level, resulting in overly conservative bounds. The wait-and-judge framework achieved the exact same probabilistic guarantees using only 596 scenarios, providing a much tighter and more useful uncertainty tube.
Fig. 3: Uncertainty tubes established in Alg. 1/Thm. 2. The uncertainty tubes following the wait-and-judge framework (gray) are tighter than the classic scenario approach (orange).
  • Hardware Deployment: The safe BO algorithm successfully optimized the controller parameters of a real Furuta pendulum over 20 iterations with zero safety violations.
Fig. 1: Control parameter tuning using safe BO on a real Furuta pendulum. Figure 1a shows the experimental setup of the Furuta pendulum [1] and Figure 1b illustrates the exploration of the parameter space. We first (upper sub- figure) conduct an experiment with the initial safe parameter (magenta diamond). Based on the observed reward and constraints, we construct uncertainty tubes, where red and blue denote high and low reward estimates, respectively. Using these estimates, we compute a safe set (green hull) that contains only parameters we believe to be safe with high probability. We sequentially evaluate new parameters using our safe BO algorithm. After 20 iterations (lower sub-figure), we have explored parts of the domain, expanded the safe set, and refined the uncertainty tubes. The cyan square marks the best parameter identified by the safe BO algorithm, which achieves significantly better control performance compared to the initial parameter, as detailed in Section VI-B.

The optimized policy significantly stabilized the system, drastically reducing pendulum angle oscillations around the upright position compared to the baseline policy.

Fig. 6: Trajectory of the pendulum angle αte. The optimized policy oscillates significantly less around the upright position of the pendulum (αte = 0) than the initial policy.

Limitations and Future Work

While powerful, the authors highlight a few areas for improvement:

  • Per-Iteration vs. Joint Safety: The current mathematical proof guarantees safety per iteration. To achieve full joint safety across an entire multi-step optimization horizon simultaneously, a classical union bound cannot be easily applied because the probability measure changes as data is collected. The authors currently use a heuristic confidence-tightening approach to mitigate this.
  • Model Misspecification: The framework assumes the chosen basis functions can adequately represent the true underlying system. Performance under severe model misspecification remains an open question.
  • Broader Control Paradigms: Future work aims to extend this function-based UQ method beyond safe BO into Model Predictive Control (MPC) and formal verification.

Summary updated

Abstract

Uncertainty quantification is essential when deploying learning-based control methods in safety-critical systems. This is commonly realized by constructing uncertainty tubes that enclose the unknown function of interest, e.g., the reward and constraint functions or the underlying dynamics model, with high probability. However, existing approaches for uncertainty quantification typically rely on restrictive assumptions on the unknown function, such as known bounds on functional norms or Lipschitz constants, and struggle with discontinuities. In this paper, we model the unknown function as a random function from which independent and identically distributed realizations can be generated, and construct uncertainty tubes via the scenario approach that hold with high probability and rely solely on the sampled realizations. We integrate these uncertainty tubes into a safe Bayesian optimization algorithm, which we then use to safely tune control parameters on a real Furuta pendulum.
BibTeX
@misc{tokmak2026safe,
  author = {Abdullah Tokmak and Toni Karvonen and Thomas B. Schön and Dominik Baumann},
  title = {{Safe learning-based control via function-based uncertainty quantification}},
  year = {2026},
  eprint = {2604.01173},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2604.01173},
}
Figure