DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction

Mayank Patel, Rahul Jain, Asim Unmesh, Karthik RamaniarXiv 2025 · DOI · arXiv

Introduction

Predicting the motion of articulated objects is a fundamental challenge in computer vision and robotics. While significant progress has been made in modeling "everyday objects" like laptops or cabinets—where parts typically move independently around a single joint—complex mechanical assemblies present a much harder problem. In engineering systems such as gear trains or rack-and-pinion mechanisms, the motion of one component is physically coupled to another through contact and meshing.

Traditional approaches rely on manual kinematic definitions in CAD tools, which are labor-intensive. DYNAMO (Dependency-Aware Deep Learning Framework) addresses this by inferring physically valid, coupled motions directly from segmented point clouds, bridging the gap between static geometry and dynamic reasoning.

Methodology

The DYNAMO framework employs a sophisticated three-stage pipeline to transform static point cloud data into dynamic temporal trajectories.

  1. Part Feature Extraction: Using a PointNet++ backbone, the model processes segmented point clouds for each individual part. This captures both fine-grained local geometric details and the broader global shape context necessary for identifying functional components.
  2. Inter-Part Relationship Modeling: At the heart of DYNAMO is its dependency-aware core. The system constructs a graph where each part is represented as a node. A contact-based heuristic identifies coupled parts, and a Graph Neural Network (GNN) facilitates information exchange between these nodes. This allows the model to learn how motion propagates through the assembly based on geometric constraints.
  3. Temporal Motion Decoder: The refined features from the GNN are passed to a Transformer decoder. This stage predicts a sequence of 6D Lie algebra vectors (twist vectors) representing SE(3) motion over time. Using Lie algebra ensures that the predicted rotations and translations remain mathematically valid and temporally smooth.
The DYNAMO architecture: PointNet++ extracts part features, a GNN models inter-part dependencies, and a Transformer decoder predicts temporal motion trajectories.

The MechBench Dataset

To support research into coupled motion, the authors introduced MechBench, a specialized benchmark dataset. Unlike existing datasets like PartNet-Mobility or Shape2Motion, which focus on independent joints, MechBench is designed specifically for systems where motion is induced by contact and transmission.

The dataset includes:

  • 693 diverse synthetic gear assemblies, covering spur, helical, bevel, worm, rack-and-pinion, and planetary systems.
  • 2,445 movable parts with high-fidelity ground-truth motion labels.
Comparison of MechBench with existing articulated motion datasets, highlighting its focus on coupled mechanical systems and part dependencies.

Key Insights and Results

DYNAMO demonstrates an impressive ability to learn emergent physics. Without explicit mathematical instruction on gear ratios, the model learns from geometry alone that a smaller gear must rotate faster than its larger meshing neighbor to maintain contact. Ablation studies confirm that the GNN-based coupling layer is essential; removing it leads to a significant drop in rotation accuracy.

Quantitatively, DYNAMO significantly outperforms baselines such as RPM-Net:

  • Accuracy: It achieved a reduction in rotation error of over 70% (3.28° vs. 15.96° mean error).
  • Scalability: The model maintains stability even as assembly complexity increases to 5–7 parts.
  • Stability: Predictions remain consistent across 35-frame sequences without the "drift" often seen in recursive models.

Conclusion and Future Directions

DYNAMO represents a significant step toward automated kinematic reasoning from raw geometry. However, the model currently relies solely on geometric cues and can occasionally predict "unphysical" behaviors, such as parts interpenetrating. Future work will focus on integrating explicit physical priors or differentiable simulations to enforce hard constraints, as well as extending the framework to handle noisy real-world sensor data and more complex mechanisms like linkages.

Summary updated

Abstract

Understanding the motion of articulated mechanical assemblies from static geometry remains a core challenge in 3D perception and design automation. Prior work on everyday articulated objects such as doors and laptops typically assumes simplified kinematic structures or relies on joint annotations. However, in mechanical assemblies like gears, motion arises from geometric coupling, through meshing teeth or aligned axes, making it difficult for existing methods to reason about relational motion from geometry alone. To address this gap, we introduce MechBench, a benchmark dataset of 693 diverse synthetic gear assemblies with part-wise ground-truth motion trajectories. MechBench provides a structured setting to study coupled motion, where part dynamics are induced by contact and transmission rather than predefined joints. Building on this, we propose DYNAMO, a dependency-aware neural model that predicts per-part SE(3) motion trajectories directly from segmented CAD point clouds. Experiments show that DYNAMO outperforms strong baselines, achieving accurate and temporally consistent predictions across varied gear configurations. Together, MechBench and DYNAMO establish a novel systematic framework for data-driven learning of coupled mechanical motion in CAD assemblies.
BibTeX
@misc{patel2025dynamo,
  author = {Mayank Patel and Rahul Jain and Asim Unmesh and Karthik Ramani},
  title = {{DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction}},
  year = {2025},
  eprint = {2509.12430},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2509.12430},
}
Figure