Learning to Ground Objects for Robot Task and Motion Planning

Yan Ding, Xiaohan Zhang, Xingyue Zhan, Shiqi Zhang

Abstract

Task and motion planning (TAMP) algorithms help robots plan behaviors in discrete and continuous spaces. However, real-world scenarios often involve unknown object properties (e.g., size and weight), making traditional planning difficult. This paper introduces Task-Motion Object-Centric planning (TMOC), a grounded TAMP algorithm that learns to ground objects and their physical properties using a physics engine. TMOC is particularly effective for dynamic, multi-object interactions. Evaluated in simulation and on a real UR5e robot, TMOC outperforms competitive baselines in cumulative utility.

Introduction: The Challenge of Unknown Physical Properties

Traditional TAMP algorithms typically assume a perfect "world model," where the robot knows exact dimensions, weights, and friction coefficients of all objects. In practice, such as in a kitchen or warehouse, these properties are often unknown. A robot might fail to stack blocks if it doesn't realize the bottom block is too light to support the others. This paper addresses the problem of planning when object properties, state mappings, and action transition functions are unknown.

Methods: Task-Motion Object-Centric Planning (TMOC)

The authors propose the Planning with Physics-based Simulation (PPS) framework and the TMOC algorithm. PPS integrates a high-fidelity physics engine to bridge symbolic states (e.g., is_holding(block)) with continuous physical parameters.

The TMOC framework architecture, illustrating the interaction between task planning, motion planning, and physics-based simulation.

The TMOC algorithm operates through several key mechanisms:

  • Optimistic Initialization: Following the R-max principle, the robot initially assumes actions will succeed.
  • Particle-based Simulation: The robot maintains $N$ "particles," representing different hypothesized object properties.
  • Dual-Loop Learning: Real-world actions are mirrored in $N$ simulated worlds. By comparing outcomes, the robot updates particle weights (similar to a particle filter), effectively learning true physical properties over time.
  • Integrated Planning: Learned properties refine both high-level task strategies and low-level motion trajectories.

Evaluation and Results

The framework was tested in a "Stack-and-Push" domain using both Pybox2D simulation and a real UR5e robotic arm.

Key Results

  • Superior Performance: TMOC significantly outperformed baselines such as TMP-RL, GP, and TOEP in cumulative utility. As the robot grounded object properties, its utility curve rose sharply.
  • Convergence and Efficiency: In simulation, TMOC achieved near 100% optimal plans after 5,000 episodes. Crucially, real-world learning was efficient, with the UR5e robot learning reliable mappings within 32 to 44 episodes (approx. 12 hours).
Comparison of TMOC against baselines (TMP-RL, GP, and TOEP) showing superior utility value over training episodes.

Discussion and Future Work

TMOC demonstrates that "grounding"—mapping symbols to physical reality—is a learning problem solvable by treating simulation parameters as latent variables. While successful in 2D-constrained environments, future work aims to extend this to unconstrained 3D spaces and optimize the computational cost of running parallel simulations. Additionally, learning to identify which objects in a scene are task-relevant could further improve efficiency.

Summary updated

Abstract

Task and motion planning (TAMP) algorithms have been developed to help robots plan behaviors in discrete and continuous spaces. Robots face complex real-world scenarios, where it is hardly possible to model all objects or their physical properties for robot planning (e.g., in kitchens or shopping centers). In this paper, we define a new object-centric TAMP problem, where the TAMP robot does not know object properties (e.g., size and weight of blocks). We then introduce Task-Motion Object-Centric planning ({\bf TMOC}), a grounded TAMP algorithm that learns to ground objects and their physical properties with a physics engine. TMOC is particularly useful for those tasks that involve dynamic complex robot-multi-object interactions that can hardly be modeled beforehand. We have demonstrated and evaluated TMOC in simulation and using a real robot. Results show that TMOC outperforms competitive baselines from the literature in cumulative utility.
BibTeX
@article{ding2022learning,
  author = {Yan Ding and Xiaohan Zhang and Xingyue Zhan and Shiqi Zhang},
  title = {{Learning to Ground Objects for Robot Task and Motion Planning}},
  journal = {IEEE Robotics Autom. Lett.},
  year = {2022},
  url = {https://openreview.net/forum?id=LwGpppjOGuu},
}
Figure