Non-rigid Reconstruction with a Single Moving RGB-D Camera

Shafeeq Elanattil, Peyman Moghadam, Sridha Sridharan, Clinton Fookes, Mark Cox

Abstract

We present a novel non-rigid reconstruction method using a moving RGB-D camera. Current approaches use only non-rigid part of the scene and completely ignore the rigid background. Non-rigid parts often lack sufficient geometric and photometric information for tracking large frame-to-frame motion. Our approach uses camera pose estimated from the rigid background for foreground tracking. This enables robust foreground tracking in situations where large frame-to-frame motion occurs. Moreover, we are proposing a multi-scale deformation graph which improves non-rigid tracking without compromising the quality of the reconstruction. We are also contributing a synthetic dataset which is made publically available for evaluating non-rigid reconstruction methods. The dataset provides frame-by-frame ground truth geometry of the scene, the camera trajectory, and masks for background foreground. Experimental results show that our approach is more robust in handling larger frame-to-frame motions and provides better reconstruction compared to state-of-the-art approaches.
BibTeX
@inproceedings{elanattil2018non,
  author = {Shafeeq Elanattil and Peyman Moghadam and Sridha Sridharan and Clinton Fookes and Mark Cox},
  title = {{Non-rigid Reconstruction with a Single Moving RGB-D Camera}},
  booktitle = {ICPR},
  year = {2018},
  doi = {10.1109/icpr.2018.8546201},
}
Figure