PolyMorphWBC: Whole-Body Control from End-Effector Trajectories for Quadrupedal Mobile Manipulation across Arm Morphologies with Extended Reach

Heng Li, Yang Li, Yifan Duan, Ren Fang, Matao Duan, Wenhao Yu, Lu Zhang, Jianmin Ji, Yanyong ZhangarXiv 2026 · arXiv

TL;DR

PolyMorphWBC is a hierarchical whole-body controller that enables quadrupedal robots to follow end-effector (EE) trajectories across diverse arm morphologies, even for targets far beyond their initial reach. By combining a trajectory-previewing coordinator with morphology-aware conditioning, the system automatically decides when and how to move the mobile base to support the arm, achieving significantly higher precision and reach than existing state-of-the-art methods.

What Problem Does This Paper Address?

Quadrupedal mobile manipulators—robots like the Unitree Go2 with an attached robotic arm—offer a compelling mix of mobility and dexterity. However, controlling them is a nightmare of coordination. A high-level task policy might say "pick up that cup," providing a short-horizon trajectory for the hand (the end-effector). The low-level controller then has to solve a complex puzzle: Should I just move the arm? Do I need to lean the base forward? Or do I need to start walking because the cup is too far away?

Most current solutions are "locked in" to a specific arm-base pair. If you swap a heavy, long-reach arm for a light, short-reach one, the controller usually fails because the kinematics and dynamics have changed. Furthermore, many controllers struggle with "extended reach"—moving the base proactively before the arm hits its physical limit. PolyMorphWBC aims to bridge this gap by creating a single, reusable control hierarchy that generalizes across different arm types and handles reach extension gracefully.

Methods

The authors propose a hierarchical architecture that separates task-level coordination from hardware-specific execution:

  1. Trajectory-Conditioned Coordinator ($\pi_W$): This is the "brain" of the system. It takes a 1-second preview of the desired EE trajectory. By looking ahead, it can anticipate when the arm is about to run out of reach and command the base to move or adjust its posture proactively.
  2. Morphology Encoder ($E_\phi$): To make the controller "poly-morphic," the authors feed it a compressed representation of the arm's URDF (Unified Robot Description Format). This encoder is pretrained to understand both kinematics (where the hand is) and dynamics (how the arm's weight affects the base).
  3. Arm-Specific IK & Locomotion Backend: While the coordination is learned, the system retains a standard Inverse Kinematics (IK) solver for the specific arm to ensure millimeter-level precision. The base movements are executed by a "frozen" locomotion backend that handles the complexities of walking.
  4. Residual-Wrench Feedback: To handle real-world discrepancies and dynamic forces not captured by the static URDF model, the system uses online feedback of the forces the arm exerts on the base.
The PolyMorphWBC pipeline showing the hierarchy from EE trajectory to arm-base motion.

Datasets

The researchers didn't just train on one or two robots. They used procedural generation to create a massive variety of arm models:

  • Four Kinematic Families: They defined templates for common arm configurations (Parallel axes, Spherical wrist, Offset wrist, and Curved wrist).
  • Randomized Dimensions: Within these families, they procedurally varied link lengths, joint limits, and inertial properties.
  • Training/Testing Split: They generated 1024 morphology-disjoint instances for training and held out 128 unique arms for validation and testing.
  • Trajectories: A bank of 100k training and 10k held-out trajectories was used, ranging from simple within-reach motions to complex extended-reach paths.

Key Insights and Ideas

  • Preview is Essential for Reach: By looking 1 second into the future, the coordinator avoids the "reactive" trap where the base only moves after the arm has already hit a limit and failed to track the target.
  • Hybrid Learning/Analytical Control: The paper argues that while base coordination is best learned (due to complex dynamics), arm execution should remain analytical (IK) to maintain precision. This "best of both worlds" approach is a key reason for their high accuracy.
  • Morphology as a Context: Treating the robot's physical description as an input "context" allows a single neural network to control vastly different robots, effectively learning the relationship between morphology and required motion rather than just memorizing one robot's behavior.

Key Results

PolyMorphWBC was tested extensively in simulation (IsaacLab and MuJoCo) and on physical hardware.

  • Generalization: It achieved a 93.95% completion rate on held-out trajectories and arm morphologies that it had never seen during training.
  • Precision: In head-to-head MuJoCo comparisons against UMI-on-Legs, PolyMorphWBC reduced end-effector position error by 69–72% and orientation error by a staggering 91–97%.
  • Extended Reach: The system successfully tracked targets more than 1 meter away from the starting position by seamlessly coordinating walking and reaching.
  • Hardware Success: The authors demonstrated the system on a real Go2-ARX5 robot, performing language-conditioned pick-and-place tasks using trajectories generated by the $\pi_0$ vision-language-action model.
Comparison of tracking performance in MuJoCo, showing PolyMorphWBC's superior accuracy over UMI-on-Legs.

Limitations and Future Work

While impressive, the authors note several areas for improvement:

  • Fixed Base Platform: The current study focuses on varying the arm while keeping the quadruped base (Unitree Go2) constant. Future work could extend this to different mobile bases.
  • Smooth Trajectories: The system was tested on relatively smooth, low-speed trajectories. High-speed, aggressive maneuvers might require more complex dynamic modeling.
  • Contact-Rich Tasks: The current framework is designed for free-space trajectory tracking. Tasks involving significant contact forces (like opening a heavy door or scrubbing a surface) remain a challenge for future iterations.
  • Known Models: The system currently assumes the arm's URDF is known. A truly "blind" adaptive controller that infers morphology purely from interaction is a potential next step.

Summary updated

Abstract

Quadrupedal mobile manipulators can extend their manipulation workspace by coordinating the mounted arm with the mobile base. At the task level, short-horizon end-effector (EE) trajectories provide an interface for specifying the desired manipulation motion without prescribing how it should be realized by the arm and base. However, executing such trajectories remains challenging because the controller must determine when and how the base should move, and this decision depends on the mounted-arm morphology. We therefore present PolyMorphWBC, a hierarchical controller that takes an EE trajectory as the sole task-level motion command and generates coordinated arm--base motions across four families of 6-DoF mounted arms, with extended-reach trajectories beyond the initial fixed-base reach. Within PolyMorphWBC, a trajectory-conditioned coordinator determines the base motion from previewed EE targets, while arm-specific Inverse Kinematics (IK) tracks the current target, and a frozen locomotion backend executes the resulting motion. Cross-arm reuse is enabled by a Unified Robot Description Format (URDF)-derived morphology conditioning, together with online residual-wrench feedback. We train PolyMorphWBC on procedurally generated arms and structured trajectories within and beyond fixed-base reach. In IsaacLab, it achieves 93.95% completion with 2.30cm position error and 4.81° orientation error on held-out trajectories and arm morphologies. In MuJoCo evaluation against UMI-on-Legs, PolyMorphWBC reduces EE position error by 69--72% and orientation error by 91--97% across four within- and extended-reach trajectories. On a physical Go2--ARX5 system, we demonstrate language-conditioned extended-reach pick-and-place using EE trajectories from pi_0 without vision-language-action (VLA)-generated base commands.
BibTeX
@misc{li2026polymorphwbc,
  author = {Heng Li and Yang Li and Yifan Duan and Ren Fang and Matao Duan and Wenhao Yu and Lu Zhang and Jianmin Ji and Yanyong Zhang},
  title = {{PolyMorphWBC: Whole-Body Control from End-Effector Trajectories for Quadrupedal Mobile Manipulation across Arm Morphologies with Extended Reach}},
  year = {2026},
  eprint = {2611.15117},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.15117},
}
Figure