TL;DR
This paper introduces a geometry-aware framework that uses "straight skeletons" to automatically label robotic grasp points, eliminating the need for costly manual annotation. By integrating these geometric priors into a novel neural network (SkelGG-CNN) and extending the method to 6-DoF point clouds, the authors achieve human-level grasping precision and high real-world success rates even with limited training data.
What Problem Does This Paper Address?
Deep learning has revolutionized robotic grasping, but it has a "data hunger" problem. Training robust models typically requires massive datasets of objects labeled with successful grasp poses. Creating these datasets manually is labor-intensive, expensive, and prone to human inconsistency.
While analytical methods (based on physics and geometry) can find grasps without manual labels, they are often too computationally heavy for real-time use or struggle with the noisy, partial data seen by real-world sensors. The authors aim to bridge this gap by using geometry to "teach" the neural network where to look, creating a pipeline that is both automated and highly efficient.
Methods
The core innovation is the use of Straight Skeletons—a geometric representation that acts like a "spine" for 2D shapes.
- Auto-Labeling Pipeline: The system extracts the skeleton of an object's contour. It then uses a pairing algorithm to find "antipodal" points (points on opposite sides of the object that allow for a stable squeeze) centered around the skeleton's nodes. This ensures grasps are physically sensible and located in high-potential regions.
- SkelGG-CNN: The authors propose a new architecture based on Generative Grasp CNNs. Unlike standard models that predict quality, angle, and width, SkelGG-CNN adds a fourth "Skeleton Heatmap" head. This heatmap guides the model to refine grasp centers toward the object's geometric medial axis, significantly improving stability.
- Generalized 6-DoF Execution: To handle 3D space, they developed a "quasi-3D" approach. They slice a 3D point cloud into horizontal 2D layers, apply skeletonization to each slice, and then link them back together to form a volumetric skeleton graph.
Datasets
The framework was validated across a wide range of standard benchmarks:
- Jacquard V1 & V2: Large-scale synthetic datasets for 4-DoF grasping.
- Cornell Grasping Dataset: A classic benchmark with human-annotated labels.
- Dex-Net: Used for simulation-based end-to-end evaluation.
- GraspNet-1Billion: Used to test the 6-DoF generalized auto-labeling in cluttered scenes.
- EGAD!: A dataset specifically designed to test generalization on complex, diverse geometries.
Key Insights and Ideas
- Skeletons as Grasp Priors: The straight skeleton naturally decomposes complex shapes into local regions that are ideal for two-finger grasping. By focusing the search space on the skeleton, the algorithm avoids the "random sampling" inefficiency of many other methods.
- Geometry-Aware Refinement: Standard generative models often predict high-quality grasps near object edges, which can lead to slips. The skeleton heatmap forces the model to prioritize the "center of mass" of a local geometry, leading to much more robust grasps.
- Data Efficiency: Because the skeleton provides such a strong geometric hint, the SkelGG-CNN can achieve high accuracy even when trained on significantly smaller datasets (e.g., ~2,600 images from Dex-Net) compared to traditional methods.
Key Results
- Benchmark Accuracy: SkelGG-CNN achieved 95.42% on Jacquard V1, 96.55% on Jacquard V2, and 97.1% on Cornell.
- 6-DoF Performance: On the challenging GraspNet "novel" split, the auto-labeling algorithm achieved an Average Precision (AP) of 18.33, which is competitive with state-of-the-art model-based approaches that require extensive training.
- Real-World Success: Using a Delta parallel robot, the system achieved a 97.4% success rate on single household objects and 95.0% in cluttered scenes. Crucially, this was achieved without any domain adaptation or real-world fine-tuning.
Limitations and Future Work
While the "quasi-3D" slicing method is efficient, the authors note it can occasionally neglect complex volumetric patterns that don't align with horizontal slices. Future work aims to develop algorithms that explicitly capture 3D topological structures without the slicing heuristic. Additionally, the current framework is optimized for two-finger grippers; extending this to multi-fingered hands and integrating tactile feedback are logical next steps to improve grasp stability in even more complex manipulation tasks.
Summary updated