KERV: Kinematic-Rectified Speculative Decoding for Embodied VLA Models

Zihao Zheng, Zhihao Mao, Maoliang Li, Jiayu Chen, Xinhao Sun, Zhaobo Zhang, Donggang Cao, Hong Mei, Xiang Chen

TL;DR

KERV (Kinematic-Rectified Speculative Decoding) significantly speeds up Vision-Language-Action (VLA) models by blending modern "token-domain" AI with traditional "kinematic-domain" robotics. By using a Kalman Filter to patch errors and dynamically adjusting its error tolerance based on physical movement, KERV achieves a 27%–37% speed boost over state-of-the-art methods with virtually no loss in task success.

What Problem Does This Paper Address?

Vision-Language-Action (VLA) models are the current "brains" of embodied intelligence, allowing robots to understand text commands and visual scenes to perform tasks. However, they are notoriously slow because they generate actions token-by-token, much like a chatbot.

To speed them up, researchers use Speculative Decoding (SD): a small, fast "draft" model guesses the next few tokens, and a large "verification" model checks them in parallel. But SD has two major headaches in robotics:

  1. The Re-inference Trap: If the draft model makes a mistake, the big model usually has to re-calculate everything from scratch (re-inference), which eats up the time saved.
  2. The Threshold Dilemma: You have to decide how much error to tolerate. If you're too strict, you never get a speedup; if you're too loose, the robot's movements become erratic and the task fails.

Methods

The authors introduce KERV, which tackles these issues by looking at the problem through the lens of robotic kinematics (the geometry of motion).

  • KF-Based Compensation Mechanism: Instead of throwing away a "wrong" draft and starting over, KERV uses a Kalman Filter (KF)—a classic tool in control theory—to predict and fill in the rest of the action sequence. Because the KF understands physical constraints, it can provide a "good enough" correction much faster than a heavy AI model can re-calculate it.
  • Kinematic-Based Threshold Adjustment (TA): KERV doesn't use a static error threshold. It monitors "kinematic variability" ($K_{var}$), which measures how much a token error actually affects the robot's physical position. If an error is mathematically small but physically risky, KERV tightens the threshold; if the error is physically negligible, it relaxes the threshold to keep the speed high.
  • CPU-GPU Collaboration: The heavy VLA models run on the GPU, while the lightweight Kalman Filter and threshold logic are offloaded to the CPU. This parallel processing minimizes the overhead of the optimization itself.

Datasets

The researchers evaluated KERV using the LIBERO benchmark, a standard for testing lifelong robot learning. They tested across four distinct suites:

  • LIBERO-Object: Manipulating various items.
  • LIBERO-Spatial: Tasks requiring precise positioning.
  • LIBERO-Goal: Reaching specific end-states.
  • LIBERO-Long: Complex, multi-step tasks.

They used OpenVLA as their primary verification model and a single LLaMA block as the draft model.

Key Insights and Ideas

  • Tokens $\neq$ Physics: The most profound insight is the "Token-Kinematic Discrepancy." In a VLA model, two tokens might be numerically close in the "token domain" but represent wildly different physical actions in the "kinematic domain." KERV is the first to use this physical reality to decide when to trust a draft.
  • Traditional Control as a Safety Net: While LLMs are great at high-level reasoning, they are inefficient at fine-grained motor control. By using a Kalman Filter as a "patch," the authors show that 20th-century control theory can still solve 21st-century AI bottlenecks.
  • Dynamic Tolerance: A fixed threshold is irrational for robots because errors accumulate. KERV’s ability to tighten its "focus" as a task progresses prevents the "drift" that often causes speculative decoding to fail in physical environments.

Key Results

  • Speed: KERV achieved a 1.48x to 1.57x speedup compared to standard VLA inference.
  • Efficiency: Compared to the previous state-of-the-art (Spec-VLA), KERV is 27%–37% faster.
  • Accuracy: Remarkably, this speed comes with nearly zero loss in Success Rate (SR). In some cases, the kinematic rectification even helped maintain a higher success rate than more aggressive speculative methods.
  • Hardware: The CPU+GPU implementation reduced end-to-end latency by an additional 7%–13% compared to running everything on a GPU.

Limitations and Future Work

  • VLA Dependency: KERV is an optimization framework; it cannot make a VLA model smarter. If the underlying OpenVLA model doesn't know how to perform a task, KERV won't fix that.
  • Simulation vs. Reality: While LIBERO is a robust benchmark, the paper focuses on simulated environments. Real-world sensors often have noise that might require further tuning of the Kalman Filter parameters.
  • Model Scope: The current work focuses on autoregressive VLA models. The authors note that applying these kinematic insights to Diffusion-based VLA models (which generate actions differently) is a promising but currently unexplored direction.

Summary updated

Abstract

Vision-Language-Action (VLA) models build a token-domain robot control paradigm, yet suffer from low speed. Speculative Decoding (SD) is an optimization strategy that can boost inference speed. Two key issues emerge when integrating VLA and SD: first, SD relies on re-inference to address token errors, which is computationally expensive; second, to mitigate token errors, the acceptance threshold in SD requires careful adjustment. Existing works fail to address the above two issues effectively. Meanwhile, as the bridge between AI and the physical world, existing embodied intelligence has overlooked the application of robotic kinematics. To address these issues, we innovatively combine token-domain VLA models with kinematic-domain prediction for SD, proposing a kinematic-rectified SD framework named KERV. We employ a kinematics-based Kalman Filter to predict actions and compensate for SD errors, avoiding costly re-inference. Moreover, we design a kinematics-based adjustment strategy to dynamically rectify the acceptance threshold, addressing the difficulty of threshold determination. Experimental results across diverse tasks and environments demonstrate that KERV achieves 27%~37% acceleration with nearly no Success Rate loss.
BibTeX
@misc{zheng2026kerv,
  author = {Zihao Zheng and Zhihao Mao and Maoliang Li and Jiayu Chen and Xinhao Sun and Zhaobo Zhang and Donggang Cao and Hong Mei and Xiang Chen},
  title = {{KERV: Kinematic-Rectified Speculative Decoding for Embodied VLA Models}},
  year = {2026},
  eprint = {2603.01581},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2603.01581},
}
Figure