Robust Nonprehensile Object Transportation With Uncertain Inertial Parameters

Adam Heins, Angela P. Schoellig

TL;DR

This paper tackles the "waiter’s problem"—transporting an object on a tray without grasping it—under significant uncertainty regarding the object's mass, center of mass (CoM), and inertia. By incorporating robust "sticking constraints" into an optimization-based motion planner and using moment relaxations to verify physical realizability, the researchers enabled a mobile manipulator to successfully transport a 56 cm tall box with unknown internal contents that caused baseline methods to fail.

What Problem Does This Paper Address?

In robotics, "nonprehensile" manipulation refers to moving objects without a firm grasp (e.g., pushing, sliding, or balancing). The classic example is the waiter’s problem, where a robot must move a tray quickly without the items sliding or tipping.

The challenge is that while a robot can "see" an object's outer shape, it often doesn't know the internal mass distribution (the inertial parameters). If a box is top-heavy or has an offset center of mass, a standard motion plan might accelerate too quickly, causing the object to fall. Most existing solutions either assume these parameters are known or only handle very small errors. This paper aims to push the limits of how much inertial uncertainty a robot can handle while still moving dynamically.

Methods

The authors propose a two-part framework:

  1. Robust Motion Planning: The task is formulated as a Constrained Optimal Control Problem (OCP). To handle uncertainty, they define a "set" of possible CoM locations (a polyhedral set). They then enforce sticking constraints—mathematical conditions that ensure the object doesn't slide or tip—for every vertex of that uncertainty set. By satisfying the constraints at the extremes, the robot ensures stability for any CoM within that volume.
  2. Verification via Moment Relaxations: To account for uncertainty in the inertia matrix (how mass is distributed around the CoM), the authors use moment relaxations (Lasserre’s hierarchy). They develop a Semidefinite Program (SDP) that checks if a planned trajectory is safe for any physically realizable mass distribution within the object's bounding shape. This provides a theoretical guarantee that the robot won't drop the object, regardless of how it is packed internally.

The trajectories are solved offline using Sequential Quadratic Programming (SQP) and then tracked by the robot using a simple feedback controller.

Datasets

The paper does not use a standard vision or language dataset. Instead, it evaluates the approach through:

  • Simulation: 1,620 total runs in the PyBullet simulator using a model of a 9-DOF mobile manipulator (Ridgeback base + UR10 arm) transporting boxes of varying heights (30 cm to 60 cm).
  • Hardware Experiments: Real-world tests using the same mobile manipulator. The "uncertain" objects were cardboard boxes containing sugar-filled bottles hidden in corners to create unknown, offset CoMs.

Key Insights and Ideas

  • Mass Independence: For a single object, the "sticking" conditions are actually independent of the total mass (assuming the robot's motors are strong enough). This allows the planner to focus purely on the CoM location and the normalized inertia matrix.
  • Geometry as a Constraint: You can't have just any inertia matrix; it must be "physically realizable" (derived from a non-negative mass density within the object's shape). The authors use this physical law to bound the search space for worst-case scenarios.
  • Robustness vs. Speed: There is an inherent trade-off. The robust planner produces slower, smoother trajectories than a "nominal" planner because it must remain safe for the worst-case CoM. However, it is still significantly faster than "quasi-static" (extremely slow) movement.

Key Results

  • Simulation Success: The proposed robust constraints achieved a 100% success rate across all tested object heights and CoM locations. In contrast, baseline methods (which assumed the CoM was at the center or top) saw success rates drop as the object height increased, failing frequently at 50–60 cm.
  • Real-World Performance: In hardware tests, the robot successfully transported a 56 cm tall box (Box2) using the robust planner. The baseline planners, which didn't account for the offset CoM, dropped the box almost immediately.
  • Verification: The SDP-based verification confirmed that the robust trajectories would not violate constraints for any physically possible internal mass distribution, whereas the baseline trajectories were mathematically guaranteed to fail for certain distributions.

Limitations and Future Work

  • Offline Planning: The current robust trajectories are calculated offline. While this ensures safety, it doesn't allow the robot to react to sudden changes in the environment (like a person walking in its path) without potentially compromising the robust constraints.
  • Computational Complexity: Solving the SDP for verification is currently too slow for real-time use (taking about 2.2 seconds per timestep). The authors suggest that future work could involve integrating these LMI (Linear Matrix Inequality) constraints directly into the motion planner if more efficient solvers are used.
  • Single Object Focus: The current math assumes a single object on the tray. Handling multiple objects that can slide into each other would require a more complex contact model.

Summary updated

Abstract

We consider the nonprehensile object transportation task known as the waiter's problem—in which a robot must move an object on a tray from one location to another—when the transported object has uncertain inertial parameters. In contrast to existing approaches that completely ignore uncertainty in the inertia matrix or which only consider small parameter errors, we are interested in pushing the limits of the amount of inertial parameter uncertainty that can be handled. We first show how constraints that are robust to inertial parameter uncertainty can be incorporated into an optimization-based motion planning framework to transport objects while moving quickly. Next, we develop necessary conditions for the inertial parameters to be realizable on a bounding shape based on moment relaxations, allowing us to verify whether a trajectory will violate the constraints for any realizable inertial parameters. Finally, we demonstrate our approach on a mobile manipulator in simulations and real hardware experiments: our proposed robust constraints consistently successfully transport a 56 cm tall object with substantial inertial parameter uncertainty in the real world, while the baseline approaches drop the object while transporting it.
BibTeX
@article{heins2025robust,
  author = {Adam Heins and Angela P. Schoellig},
  title = {{Robust Nonprehensile Object Transportation With Uncertain Inertial Parameters}},
  journal = {IEEE Robotics Autom. Lett.},
  year = {2025},
  doi = {10.1109/lra.2025.3551067},
}

Loading related content...

Figure