Risk-Controlled Test-Time Adaptation for Vision-Language-Action Models

Zixuan Liu, Hashem Haghbayan, Zizhan Zheng, Siavash KhajaviarXiv 2026 · arXiv

TL;DR

R2-VLA is a new framework that makes retrieval-augmented robotic models significantly more reliable by teaching them to "know what they don't know." By combining a learned uncertainty predictor with a formal risk-control procedure, the system can guarantee a user-specified task success rate, requesting expert intervention only when necessary and progressively reducing its reliance on humans by learning from their corrections.

What Problem Does This Paper Address?

Vision-Language-Action (VLA) models are the "brains" of modern general-purpose robots, translating visual inputs and text instructions into physical movements. However, these models often stumble when faced with new environments or objects (distribution shifts).

A popular fix is Retrieval-Augmented In-Context Learning (RICL), where the robot looks up similar expert demonstrations from a "memory" buffer to guide its current task. The problem? Simply having relevant examples doesn't guarantee the robot will use them correctly. As shown in Figure 1(a), a robot might retrieve the perfect demonstration for moving a bowl but still push it in the wrong direction, leading to failure.

Current systems lack a mechanism to assess their own confidence or provide formal guarantees that a task will actually succeed.

Figure 1: Comparison of RICL (failure) and R2-VLA (success). R2-VLA detects high uncertainty and asks for help, eventually completing the task.

Methods

The authors propose R2-VLA (Risk-Controlled Retrieval-Augmented VLA), which introduces three key components:

  1. Uncertainty Predictor ($U_\psi$): Instead of relying on simple visual similarity metrics, the authors add a lightweight MLP "head" to a frozen VLA backbone. This head learns to predict the discrepancy between the model's predicted action and the ground-truth expert action. Crucially, they train this head using "corrupted" retrieval contexts (e.g., wrong-task or out-of-phase demos) to teach it exactly what failure looks like.
  2. ACT/ASK Decision Rule: At every timestep, the robot predicts an action and an uncertainty score. If the uncertainty is below a calibrated threshold ($\lambda$), the robot acts autonomously (ACT). If it exceeds the threshold, it pauses and requests expert assistance (ASK).
  3. Risk-Controlled Calibration: This is the "secret sauce." Using a small held-out calibration dataset, the framework uses statistical hypothesis testing (specifically, a procedure based on Conformal Risk Control) to find a threshold $\lambda$ that ensures the overall task failure rate stays below a user-defined limit (e.g., "I want a 90% success rate").
  4. Continual Adaptation: When an expert provides a correction during an "ASK" step, that correction is added to the retrieval buffer. The system then recalibrates its threshold to maintain its safety guarantees while benefiting from the expanded memory.

Datasets

The researchers evaluated R2-VLA using the LIBERO benchmark, a simulated robotic manipulation environment based on a Franka Panda arm. They tested across four distinct suites:

  • LIBERO-SPATIAL: Focuses on spatial relationships.
  • LIBERO-OBJECT: Involves diverse object types.
  • LIBERO-GOAL: Tests different task goals in the same scene.
  • LIBERO-LONG: Features long-horizon tasks that are more difficult to complete.

They used three different VLA backbones to prove generality: MiniVLA (small), $\pi_0$-FAST (medium), and OpenVLA (large).

Key Insights and Ideas

  • Relevance $\neq$ Usefulness: The most important "aha" moment is that a retrieved demonstration can be behaviorally relevant but still lead to a model failure. Uncertainty must be derived from the model's internal state, not just the "distance" between images.
  • Learning from Corruption: To make the uncertainty head robust, you have to show it bad examples. By deliberately feeding the model misleading demonstrations during training, the authors forced the uncertainty head to learn the subtle signs of a model being "led astray" by its context.
  • Task-Level vs. Step-Level: Most prior work focuses on the uncertainty of a single action. R2-VLA bridges the gap to task-level success. It doesn't just care if one move is shaky; it cares if the whole trajectory is likely to fail.
  • Provable Safety: By using formal risk control, the authors move away from "heuristic" thresholds (like 0.5) toward statistically grounded ones that respect user requirements.

Key Results

R2-VLA consistently outperformed the standard RICL baseline across all backbones and task suites:

  • Success Rate Boost: R2-VLA improved average task success by 9.2 to 11.2 percentage points.
  • Reliability: The framework met or exceeded the user-specified target success rates in 11 out of 12 experimental settings.
  • Efficiency: As the robot learns through continual adaptation, the frequency of "ASK" requests drops significantly while the success rate continues to climb. This is visualized in the "ASK reduction" and "Success improvement" plots in Figure 4.
Figure 4: Continual memory adaptation. Over several rounds, success improves and the need for expert help (ASK rate) drops.

Detailed quantitative results are captured in Table 1, showing that R2-VLA achieves these gains with manageable levels of expert intervention.

Table 1. Task success and ASK rate on LIBERO. SR denotes success rate.

Limitations and Future Work

  • Expert Availability: The system relies on an "expert" (an oracle policy in these experiments) to provide corrections and for the calibration phase. In real-world deployments, this would require a human-in-the-loop.
  • Simulation to Reality: While LIBERO is a standard benchmark, the paper does not demonstrate results on physical hardware, where noise and latency might affect uncertainty estimation.
  • Calibration Overhead: The risk-control procedure requires a dedicated calibration dataset. While the authors show this can be done with relatively few samples ($N_{cal}=200$), it still represents an upfront cost for new task domains.
  • Future Direction: The authors suggest exploring more complex "expert" behaviors, such as providing natural language feedback instead of just direct action corrections.

Summary updated

Abstract

Retrieval-augmented vision-language-action (VLA) models enable efficient test-time adaptation by leveraging expert demonstrations as additional context without updating model parameters. However, even when retrieved demonstrations are relevant to the current task, the VLA may fail to effectively utilize the retrieved information, ultimately leading to task failure. To address this challenge, we propose R2-VLA, a risk-controlled retrieval-augmented VLA framework that enables reliable test-time adaptation by satisfying a user-specified task success rate requirement with minimal expert assistance. Specifically, R2-VLA learns an uncertainty predictor that estimates the uncertainty of the VLA's predicted actions given the retrieved demonstrations, guiding when to act autonomously or request expert assistance. We further introduce a task-level risk-control procedure that calibrates the uncertainty threshold to satisfy a user-specified task-failure risk requirement. Moreover, R2-VLA continually incorporates expert corrections into its retrieval memory to improve future adaptation while preserving the prescribed task-level risk guarantee. Experiments across three VLA backbones and four LIBERO benchmark suites demonstrate that R2-VLA improves average task success by 9.2--11.2 percentage points, achieving the desired target with fewer expert requests. These results highlight the effectiveness of connecting the usefulness of retrieved demonstrations with task-level risk control to enable successful robotic manipulation.
BibTeX
@misc{liu2026risk,
  author = {Zixuan Liu and Hashem Haghbayan and Zizhan Zheng and Siavash Khajavi},
  title = {{Risk-Controlled Test-Time Adaptation for Vision-Language-Action Models}},
  year = {2026},
  eprint = {2611.26438},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.26438},
}
Figure