Risk-Triggered Search: Behavior-Preserving Safe Control

Xinyu Deng, Bohao Lan, Kunpeng Li, Mingkai Yuan, Weihang Pan, Binbin LinarXiv 2026 · arXiv

TL;DR

Researchers from Zhejiang University have introduced Risk-Triggered Search (RTS), a method to enforce safety in pre-trained visual world models without retraining the entire architecture. By unrolling future latent states to predict "process risk" and only intervening when an alarm is triggered, RTS significantly improves safety (up to 41 percentage points) while cutting computation time by up to 70%.

What Problem Does This Paper Address?

Modern visual world models, such as those based on the Joint-Embedding Predictive Architecture (JEPA), are excellent at generating multi-step plans to reach a goal. However, they suffer from a "terminal-proximity" bias: they care about reaching the destination but often ignore the hazards encountered along the way, such as clipping through walls or entering forbidden zones.

Enforcing safety in these models is difficult because:

  1. Lack of Explicit Geometry: Purely visual models don't have access to analytical dynamics or collision meshes.
  2. Computational Cost: Running a safety-constrained search (like the Cross-Entropy Method, or CEM) at every single timestep is too slow for real-time control.
  3. Representation Drift: Fine-tuning a large pre-trained model for safety often degrades its original task performance.

Methods

The authors propose a "selective intervention" framework that keeps the core world model frozen.

1. Action-Conditioned Risk Prediction

Instead of looking at a single static image, RTS "unrolls" a candidate action plan through the frozen world model to generate a sequence of predicted latent states (prefixes). A lightweight risk head is trained to look at these future latents and predict the likelihood of a process violation.

2. Risk-Triggered Gating

RTS uses a "trigger gate." If the predicted risk of the current nominal plan is below a threshold, the plan executes directly. If an alarm is triggered, the system launches a local CEM search to find a new plan that is both safe and as close as possible to the original intent.

3. Amplitude-Preserving Metric ($d_{AP}$)

A common failure in safe control is "stalling"—the robot simply stops because "doing nothing" is the mathematically closest safe action to an unsafe one. To fix this, the authors introduced $d_{AP}$, a metric that penalizes shrinking the magnitude of actions. This encourages the robot to maintain its speed and "glide" tangentially around obstacles rather than coming to a dead halt.

Figure 1. Schematic of risk-triggered correction. Direct/Guarded A issue obstacle-directed commands (red), RTS-MSE (mean squared error) stalls (gray), and RTS-AP preserves tangential pro- gression (green). Safe nominal plans pass directly (blue, bt = 0); risk alarms trigger search (bt = 1).

Datasets

The researchers evaluated RTS across five distinct benchmarks:

  • TwoRoom: A navigation task requiring precise movement through doorways.
  • Reacher: Articulated control where the arm must avoid forbidden zones.
  • SimplePointMaze: Navigation across 64 previously unseen maps to test generalization.
  • Cube & PushT: Complex contact manipulation tasks involving object-to-hazard and tool-to-hazard avoidance.

Key Insights and Ideas

  • The Future is in the Latents: You cannot determine if a plan is safe just by looking at the current state. By unrolling the world model's internal predictions, RTS "sees" potential collisions before they happen.
  • Lossless Acceleration: The authors prove (Proposition 1) that if the nominal plan is safe, bypassing the search is mathematically identical to performing a full search. This allows for massive speedups without any loss in behavior quality.
  • Unified Gating: Using the exact same risk criterion for both triggering the search and filtering the results ensures that the system doesn't oscillate between safe and unsafe plans.
Figure 2. Overall RTS architecture. Frozen policy π generates nominal plan UD, and world model F unrolls predicted latent prefixes ˆz0:H−1 scored by risk head Rϕ. Safe plans (bt = 0) pass directly; alarms (bt = 1) launch 3-round CEM search using the same risk criterion to define feasibility Ft, where amplitude-preserving selection minimizes dAP.

Key Results

  • Safety Gains: RTS-AP improved the Safe Arrival Rate (SAR) over the baseline "Direct" controller by 12.67 to 41.67 percentage points across navigation and articulated tasks.
  • Efficiency: By only searching when necessary, RTS reduced controller latency by 17.71% to 70.41% compared to searching at every step.
  • Behavior Preservation: In 1,968 paired trajectories, RTS maintained 100% action identity with every-step search methods, proving that selective intervention is indeed "lossless."
  • Generalization: On unseen PointMaze maps, the use of an explicit local risk field (sampling the visual geometry) raised SAR to 78.12%, far outperforming global latent features.
Figure 3. Five-task risk discrimination and controller overhead. (a) Within-context candidate risk ranking AUROC. (b) Candidate hazard recall and safe false-alarm rate. (c) Episode controller time ratios (< 1.0: savings). Timing cohorts and execution settings are specified in Appendix A.3.

Limitations and Future Work

While RTS is highly effective, the authors noted several areas for improvement:

  • Visual Resolution: The system's safety is still bounded by the resolution of the visual encoder. Very thin or small boundaries might be missed.
  • Static Thresholds: In high-frequency contact tasks like PushT, a static risk threshold can be brittle. Future work could involve dynamic or adaptive thresholds.
  • Local Minima: Like all sampling-based methods, CEM can get stuck in deep "cul-de-sacs" if the initial proposals are poor. Integrating more diverse or goal-masked proposals could help navigate complex mazes.

Summary updated

Abstract

Pre-trained visual world models generate multi-step action plans from current and goal observations, yet terminal-proximity objectives fail to prevent forbidden-zone traversal or rigid-body collision sliding. Purely visual interfaces may lack analytical dynamics, structured states, or explicit collision geometry, requiring internal prediction of action-conditioned process risk. We propose Risk-Triggered Search (RTS) for frozen Joint-Embedding Predictive Architecture (JEPA) world models. Rather than relying on static state features that cannot distinguish candidate plans sharing an observation, RTS unrolls action-conditioned future latent prefixes in the frozen world model and trains a lightweight risk head with process-violation supervision. To intervene selectively while preserving safe nominal behavior, RTS uses the same predicted prefix-risk criterion as both the search trigger gate and hard feasibility gate: safe nominal plans execute directly, whereas alarms trigger local Cross-Entropy Method (CEM) search to minimize nominal deviation within the feasible set. To prevent isotropic Euclidean minimal modification from shrinking obstacle-directed actions into zero-amplitude stalling, we introduce an amplitude-preserving metric $d_{\mathrm{AP}}$ that retains tangential progression while maintaining a unique zero at the nominal plan. Under unified gating and this unique-zero condition, bypassing safe-state search yields closed-loop trajectories strictly identical to every-step same-kernel search. Evaluated under a process-safety benchmark and Safe Arrival Rate (SAR) metric across five tasks, RTS improves SAR over Direct by 12.67--41.67 percentage points on navigation and articulated control and +2.08/+4.17 pp on Cube/PushT boundary cohorts, maintaining 100% action identity with every-step search while cutting controller time by 17.71%--70.41% across 1,968 paired trajectories.
BibTeX
@misc{deng2026risk,
  author = {Xinyu Deng and Bohao Lan and Kunpeng Li and Mingkai Yuan and Weihang Pan and Binbin Lin},
  title = {{Risk-Triggered Search: Behavior-Preserving Safe Control}},
  year = {2026},
  eprint = {2611.24409},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.24409},
}
Figure