DKWBC: Decoupling Motion Tracking and Balancing for Humanoid Whole-Body Control

Dingkun Wei, Zehong Shen, Huaijin Pi, Xueyang Wang, Xing Zhu, Hujun Bao, Yujun Shen, Xiaowei Zhou

TL;DR

DKWBC (Dynamics-informed Whole-Body Control) improves humanoid robot performance by decoupling motion tracking from balancing. By using a physics-based model to handle the nominal torques required for movement and a reinforcement learning (RL) policy to provide "residual" torques for balance, the system achieves higher tracking accuracy and better stability than end-to-end learning methods.

What Problem Does This Paper Address?

Humanoid robots are notoriously difficult to control because they must simultaneously follow complex reference motions (tracking) and stay upright (balancing) under gravity and external disturbances.

Most recent reinforcement learning approaches try to solve both problems at once: a single neural network predicts joint position targets, which a PD controller then turns into torques. However, the authors argue this "coupled" approach is flawed. Similar poses can require vastly different torques depending on the robot's velocity and acceleration. Forcing a single policy to learn these motion-dependent dynamics alongside balance corrections often leads to conservative, inaccurate movements or high-frequency jitters.

Comparison between existing coupled methods and the proposed decoupled DKWBC approach.

Methods

The core idea of DKWBC is a dynamics-informed control decomposition. It splits the total joint torque command into two distinct parts:

  1. Model-Based Tracking Module: This module uses the robot's known physics (Inverse Dynamics) to calculate the "nominal" torques needed to follow a reference motion. It includes feedforward terms (acceleration, Coriolis, and gravity) and a low-gain PD feedback loop to correct small errors. This runs at a high frequency (200Hz).
  2. Learned Balancing Policy: A residual RL policy predicts additional torque corrections at a lower frequency (50Hz). Crucially, this policy outputs direct torques rather than position targets. It is also given the model-based torque components as observations, allowing it to "see" what the tracking module is already doing and focus purely on compensating for environmental forces, payloads, and model inaccuracies.
Overview of the DKWBC framework, showing the interaction between the Tracking Module and the Balancing Policy.

Datasets

The authors trained and evaluated their system using several large-scale humanoid motion datasets:

  • BONES-SEED: A massive dataset of human motions. The authors used up to 128 hours of motion for training and tested on separate "test-content" (unseen motion types) and "test-repetition" (unseen instances of seen motion types) splits.
  • LAFAN & AMASS: Used for ablation studies and evaluating performance under external force perturbations.
  • Real-world testing: The system was validated on a Unitree G1 humanoid robot performing squats, walking, and jumping.

Key Insights and Ideas

  • Simplifying the Learning Task: By offloading the "physics" of movement to a model-based tracker, the RL policy doesn't have to waste capacity learning basic dynamics. It can focus its learning budget on the harder, less predictable task of balancing.
  • The Role of the Residual: The authors found that the learned residual torque closely matches the theoretical "environmental wrench" (the forces from ground contact). This confirms that the policy is indeed learning to handle contact and balance rather than just "fixing" the tracker's motion.
  • Direct Torque vs. Position Targets: Predicting torques directly prevents the policy from "cheating" by using high-frequency PD gains to track motions, which often leads to poor generalization. Instead, it forces the policy to learn a more fundamental balancing strategy.
Visualization of how the learned residual torque aligns with contact-compensation torques during ground contact.

Key Results

DKWBC consistently outperformed the state-of-the-art SONIC baseline across various metrics:

  • Data Efficiency: DKWBC trained on just 4 hours of data achieved better tracking accuracy than SONIC trained on 128 hours.
  • Tracking Accuracy: On the BONES-SEED test set, DKWBC reduced the Mean Per Joint Position Error (MPJPE) by approximately 22% compared to the official SONIC checkpoint.
  • Robustness: In simulations with external forces and payloads (like a 5kg backpack), DKWBC maintained significantly lower tracking errors than coupled baselines while keeping comparable success rates.
  • Hardware Generalization: A single policy trained in simulation successfully controlled a real Unitree G1 robot for diverse tasks, including deep squats and walking with heavy hand-held loads.
Quantitative results showing DKWBC's superior success rate and lower tracking error across different training data scales.

Limitations and Future Work

While DKWBC excels at tracking and balancing, the authors note a few areas for improvement:

  • Task Success: The current evaluation focuses on motion fidelity and balance, but does not explicitly measure success in specific manipulation tasks (e.g., successfully opening a door while walking).
  • Force Regulation: The system compensates for external forces but does not yet include explicit force regulation or tactile feedback.
  • Future Directions: The authors plan to extend this decoupled architecture to more complex whole-body interaction tasks, such as collaborative carrying or navigating highly cluttered environments.

Summary updated

Abstract

Humanoid whole-body control requires a robot to track diverse reference motions while maintaining balance under gravity, torque limits, contact switching, and external disturbances. Existing reinforcement-learning-based trackers typically learn control outputs that jointly address motion tracking and balance. However, similar reference poses can correspond to substantially different dynamic demands, requiring a unified policy to learn motion-dependent control requirements alongside balance corrections. This can complicate learning and lead to high-frequency fluctuations in control outputs. We propose DKWBC, a dynamics-informed whole-body control framework that combines explicit model-based tracking with a learned balancing residual. Inspired by the model-based and environmental-wrench contributions to joint torques in floating-base dynamics, DKWBC uses inverse-dynamics feedforward and joint PD feedback to supply tracking torques, while a residual policy learns additional joint-torque corrections for balanced execution. By explicitly accounting for motion-dependent torque demands, this structure simplifies the policy's learning task. Experiments in simulation and on real hardware demonstrate that a single learned balancing policy generalizes across motion datasets while maintaining accurate motion tracking and balance across ground support, attached payloads, and physical interaction. Project page: https://robbyant-research.github.io/DKWBC/.
BibTeX
@misc{wei2026dkwbc,
  author = {Dingkun Wei and Zehong Shen and Huaijin Pi and Xueyang Wang and Xing Zhu and Hujun Bao and Yujun Shen and Xiaowei Zhou},
  title = {{DKWBC: Decoupling Motion Tracking and Balancing for Humanoid Whole-Body Control}},
  year = {2026},
  eprint = {2611.09605},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.09605},
}
Figure