1P2-N-097 Reconstruction Processing of Somersault Using Dynamical Model Based on Three Dimensional Model Matching Method(Digital Human 3,Mega-Integration in Robotics and Mechatronics to Assist Our Daily Lives)

Shuetsu Kikuchi, Hideo Saitô, Kazuo NakazawaThe Proceedings of JSME Annual Conference on Robotics and Mechatronics (Robomec) 2005 · DOI

Introduction

Capturing the 3D motion of a human body in mid-air—such as during gymnastics or diving—is notoriously difficult for traditional computer vision. Unlike walking or running, where the feet provide a consistent point of contact with the ground, a "floating system" (a body in freefall) lacks a fixed reference point. Standard 3D model matching often fails during these maneuvers because the movements are too fast, limbs frequently overlap (self-occlusion), and the search space for possible joint positions in every frame is computationally massive.

Methodology

Researchers at Keio University have developed a method to reconstruct complex, high-speed aerial acrobatics in 3D from video footage. The core innovation lies in a hybrid approach that combines computer vision with biomechanical constraints.

3D Model Matching and Dynamical Modeling

The system attempts to fit a digital human template to the silhouettes or features found in video frames. Instead of treating each frame as an independent image, the researchers built a dynamical model of the human body. This model treats the person as a system of interconnected segments subject to the physics of a "floating system."

The 3D digital human model used as a template for the matching process.

Velocity Constraint Equations

By solving equations related to velocity constraints, the system estimates the physical limits of how much a joint can move between frames. These physical constraints are used to prune the search space. If a proposed 3D pose in frame B is physically impossible to reach from the pose in frame A given the time elapsed and the body's momentum, the system ignores it. This significantly improves the accuracy of joint angle estimation.

Results

The researchers successfully demonstrated the reconstruction of a complex aerial maneuver: the forward one-turn somersault with a half-twist in a straight position. The system was able to recover the 3D posture and joint angles throughout the entire flight phase.

Comparison between the original video footage (left) and the reconstructed 3D model (right).

By applying a dynamical model, the authors turn a high-dimensional search problem into a much narrower, physically-grounded optimization task. The center of mass follows a predictable parabolic trajectory, which further stabilizes the reconstruction.

Conclusion

This research highlights how physics-based filters can mitigate "visual noise" in motion capture. By knowing the velocity limits of human joints, the algorithm avoids common pitfalls like "teleporting" limbs. Future work will focus on extending this to more complex body positions (tucked or piked) and achieving real-time performance for live coaching feedback.

Summary updated

Abstract

Tlie movement of six degree of person ' s face is measured by noncontact Construction of face measurement system with a
BibTeX
@inproceedings{kikuchi2005p,
  author = {Shuetsu KIKUCHI and Hideo Saitô and Kazuo Nakazawa},
  title = {{1P2-N-097 Reconstruction Processing of Somersault Using Dynamical Model Based on Three Dimensional Model Matching Method(Digital Human 3,Mega-Integration in Robotics and Mechatronics to Assist Our Daily Lives)}},
  booktitle = {The Proceedings of JSME Annual Conference on Robotics and Mechatronics (Robomec)},
  year = {2005},
  doi = {10.1299/jsmermd.2005.111\_4},
}
Figure