Divide and Rule: Recurrent Partitioned Network for Dynamic Processes

Qianyu Feng, Bang Zhang, Yi YangarXiv 2021 · arXiv · OpenReview

Abstract

Many dynamic processes involve interacting variables, from physical systems to sociological analysis. The interplay of components can give rise to confounding behavior. Traditional approaches often model temporal sequences holistically, ignoring internal interactions. We propose the REcurrent partItioned Network (REIN) to represent systems with a part-whole hierarchy and discover implied dependencies. REIN consists of a perceptive module for hierarchical representation, a deductive module for relational connection (causal discovery), and a statistical module for future prediction. Experiments on diverse physical systems demonstrate REIN's effectiveness in identifying interactions and its stability in long-term predictions.

Introduction

Modeling complex dynamic systems—such as human skeletal movement or interacting particle systems—is a significant challenge in machine learning. Standard deep learning models often treat these systems as holistic "blobs" of data, failing to capture the "protogenic actuation"—the internal forces and dependencies between sub-components. For instance, predicting a hand's position is more robust when the model understands its attachment to the arm and torso.

Hierarchical decomposition of human body and hand parts into sub-systems.

Ignoring this underlying structure leads to several issues:

  1. Long-term instability: Errors compound, causing predictions to drift or explode.
  2. Sensitivity to noise: Models struggle to distinguish random noise from actual structural changes.
  3. Lack of transparency: It is difficult to interpret the causal drivers of system behavior.

Methodology: The REIN Architecture

The Recurrent Partitioned Network (REIN) addresses these issues by structuring the neural network to mirror the physical hierarchy of the system.

The REIN architecture: (left) temporal update with cross-level transmission; (top right) reparameterization; (bottom right) causality discovery via Directed Acyclic Graphs (DAG).

Hierarchical Partitioning

The system is divided into levels of "partitioned neurons." In a human motion context, this translates to a hierarchy of joints, limbs, and the trunk. This structure serves as a powerful inductive bias, making the model more sample-efficient than "flat" architectures like standard LSTMs.

Three-Way Communication and Causal Discovery

REIN facilitates information flow in three directions:

  • Upward: Aggregating local states from lower levels into higher-level representations.
  • Downward: Passing global "control" messages to activate and update specific sub-parts. This branch is crucial for coordinating sub-parts toward a global goal (e.g., a "jump" action).
  • Sibling (Causal Discovery): The model dynamically learns a Directional Acyclic Graph (DAG) to infer real-time influences between components at the same level. This allows the model to detect when connections between variables are active or inactive.

Temporal Variational Auto-Encoder (VAE)

To manage inherent noise and randomness, REIN utilizes a VAE framework. By estimating the distribution of future states rather than single points, the model maintains consistency over long temporal sequences.

Experimental Evaluation

The model was tested on physical simulations (Springs, Charged Particles, and Multi-ball systems) and human 3D motion synthesis (NTU-RGB-D and HumanAct12).

Key Results

  • Superior Long-term Stability: In spring simulations, REIN achieved a Mean Squared Error (MSE) of $8.34e^{-5}$ at 50 steps, nearly two orders of magnitude better than a standard LSTM ($6.73e^{-3}$).
  • Causal Accuracy: In the multi-ball system, REIN identified invisible physical connections (like rigid rods or springs) with 94.7% accuracy in a completely unsupervised manner.
  • Realistic Motion Synthesis: On the HumanAct12 dataset, REIN achieved a Frechet Inception Distance (FID) of 0.270, vastly outperforming the previous state-of-the-art t-VAE (2.458). A lower FID indicates that the generated motions are much more realistic.

Conclusion and Future Work

REIN demonstrates that incorporating hierarchical structure and dynamic causal discovery significantly improves the modeling of complex dynamic processes. While current implementations require predefined hierarchies, future research could focus on automatically learning optimal structures from raw data. Additionally, balancing the computational cost of real-time DAG inference with model granularity remains an area for optimization.

Summary updated

Abstract

In general, many dynamic processes are involved with interacting variables, from physical systems to sociological analysis. The interplay of components in the system can give rise to confounding dynamic behavior. Many approaches model temporal sequences holistically ignoring the internal interaction which are impotent in capturing the protogenic actuation. Differently, our goal is to represent a system with a part-whole hierarchy and discover the implied dependencies among intra-system variables: inferring the interactions that possess causal effects on the sub-system behavior with REcurrent partItioned Network (REIN). The proposed architecture consists of (i) a perceptive module that extracts a hierarchical and temporally consistent representation of the observation at multiple levels, (ii) a deductive module for determining the relational connection between neurons at each level, and (iii) a statistical module that can predict the future by conditioning on the temporal distributional estimation. Our model is demonstrated to be effective in identifying the componential interactions with limited observation and stable in long-term future predictions experimented with diverse physical systems.
BibTeX
@misc{feng2021divide,
  author = {Qianyu Feng and Bang Zhang and Yi Yang},
  title = {{Divide and Rule: Recurrent Partitioned Network for Dynamic Processes}},
  year = {2021},
  eprint = {2106.00258},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2106.00258},
}
Figure