Category-Level Articulated Object 9D Pose Estimation via Reinforcement Learning
Lists
Only you see this
Abstract
Human life is populated with articulated objects. Current category-level articulated object 9D pose estimation (Articulated Object 9D Pose Estimation, ArtOPE) methods usually meet the challenges of shared object representation requirement, kinematics-agnostic pose modeling and self-occlusions. In this paper, we propose a novel framework called Articulated object 9D Pose Estimation via Reinforcement Learning (ArtPERL), which formulates the category-level ArtOPE as a reinforcement learning problem. Given a point cloud or RGB-D image input, ArtPERL firstly retrieves the part-sensitive articulated object as reference point cloud, and then introduces a joint-centric pose modeling strategy that estimates 9D pose by fitting joint states via reinforced agent training. Finally, we further propose a pose optimization that refine the predicted 9D pose considering kinematic constraints. We evaluate our ArtPERL on various datasets ranging from synthetic point cloud to real-world multi-hinged object. Experiments demonstrate the superior performance and robustness of our ArtPERL. Our work provides a new perspective on category-level articulated object 9D pose estimation and has the potential to be applied in many fields, including robotics, augmented reality, and autonomous driving.
BibTeX
@inproceedings{liu2023category,
author = {Liu Liu and Jianming Du and Hao Wu and Xun Yang and Zhenguang Liu and Richang Hong and Meng Wang},
title = {{Category-Level Articulated Object 9D Pose Estimation via Reinforcement Learning}},
booktitle = {ACM Multimedia},
year = {2023},
doi = {10.1145/3581783.3611852},
}Loading related content...