Motion Compression using Principal Geodesics Analysis

Maxime Tournier, Lionel Revéret, Xiaomao Wu, Nicolas Courty, Élise Arnaud

TL;DR

This paper introduces a novel lossy compression technique for human motion capture data that leverages Principal Geodesics Analysis (PGA) to create a compact pose model. By representing poses as deviations from principal geodesics, the method achieves significant compression ratios with minimal perceptual error, making motion data more manageable for storage and transmission.

What Problem Does This Paper Address?

The increasing demand for high-quality human animation in fields like video games and film has led to an explosion of motion capture data. This data is notoriously large, posing significant challenges for storage and real-time transmission. While existing methods exploit temporal and spatial redundancies, this paper tackles the problem by focusing on the inherent structure of human poses themselves. The core challenge is to represent complex, multi-joint human motion in a significantly smaller footprint without sacrificing visual fidelity.

Methods

The authors propose a novel approach that combines Principal Geodesics Analysis (PGA) with an inverse kinematics (IK) solver.

  1. Principal Geodesics Analysis (PGA): Instead of traditional Principal Component Analysis (PCA) which assumes linear relationships, PGA is used to model the manifold of human poses. This is crucial because the space of joint orientations (SO(3)) is curved, and PGA can capture these non-linear relationships more effectively. The method identifies "principal geodesics" which act like eigenposes, representing the most significant variations in the motion. A compact pose model is built by approximating poses as combinations of these principal geodesics.
  2. Data-Driven Inverse Kinematics (IK): The compression is achieved by storing only the parameters of this PGA model, along with the trajectories of the end-effectors (hands, feet) and the root joint. To reconstruct the full motion, an IK solver is employed. This IK solver is "data-driven" because it uses the learned PGA model and optimizes the geodesic coordinates to match the end-effector positions. This approach is more efficient than traditional IK because the optimization space is smaller and inherently exploits joint correlations.
  3. Multiscale Representation: For further compression, the root joint's orientation and position, as well as the end-effector trajectories, are compressed using a multiscale representation technique that exploits Riemannian symmetric spaces.

Datasets

Not discussed in the paper. The paper focuses on a single motion for building the pose model and then evaluates compression on various motion sequences.

Key Insights and Ideas

  • PGA for Pose Manifolds: Recognizing that joint orientations lie on a curved manifold (SO(3)) and that linear methods like PCA are insufficient, the authors' application of PGA to model human poses is a key innovation. This allows for a more accurate and compact representation of the complex relationships between joints.
  • Data-Driven IK for Reconstruction: The integration of a data-driven IK solver that leverages the PGA model for reconstruction is a clever way to achieve both compression and efficient, natural-looking motion recovery. It turns the problem of pose reconstruction into an optimization problem within the learned manifold.
  • Exploiting Inherent Redundancies: The method effectively exploits both temporal coherence (through the multiscale representation of trajectories) and spatial coherence (through the PGA-based pose model), leading to high compression ratios.
  • Motion Editing Potential: The paper highlights that by storing the PGA model and end-effector trajectories, the system is naturally suited for motion editing, as modifying end-effector paths can lead to intuitive changes in the overall animation.

Key Results

The paper demonstrates significant compression ratios, with examples showing ratios of 1:182, 1:118, and 1:97 for different motion sequences. The distortion rates are reported to be low (e.g., 5.1, 7.1), suggesting good perceptual quality. Decompression times are in the order of tens of milliseconds per frame, which, while not real-time for all applications, is promising. The number of geodesics used for representation directly impacts decompression speed.

Limitations and Future Work

  • Decompression Speed: While promising, the decompression time per frame might not be fast enough for real-time video game applications. The authors suggest that IK performance can be substantially improved.
  • Perceptual Metric: The paper acknowledges the difficulty in objectively assessing perceptual closeness of animations, relying on a metric similar to previous work.
  • Future Work: The authors envision further improvements to IK performance and suggest that the system's inherent structure makes it a powerful tool for both motion compression and editing.

Summary updated

Abstract

Due to the growing need for large quantities of human animation data in the entertainment industry, it has become a necessity to compress motion capture sequences in order to ease their storage and transmission. We present a novel, lossy compression method for human motion data that exploits both temporal and spatial coherence. Given one motion, we first approximate the poses manifold using Principal Geodesics Analysis (PGA) in the configuration space of the skeleton. We then search this approximate manifold for poses matching end-effectors constraints using an iterative minimization algorithm that allows for real-time, data-driven inverse kinematics. The compression is achieved by only storing the approximate manifold parametrization along with the end-effectors and root joint trajectories, also compressed, in the output data. We recover poses using the IK algorithm given the end-effectors trajectories. Our experimental results show that considerable compression rates can be obtained using our method, with few reconstruction and perceptual errors.
BibTeX
@article{tournier2009motion,
  author = {Maxime Tournier and Lionel Revéret and Xiaomao Wu and Nicolas Courty and Élise Arnaud},
  title = {{Motion Compression using Principal Geodesics Analysis}},
  journal = {Computer Graphics Forum},
  year = {2009},
  doi = {10.1111/j.1467-8659.2009.01375.x},
}

Loading related content...

Figure