2-D mesh-based synthetic transfiguration of an object with occlusion

Candemir Toklu, A. Tanju Erdem, A. Murat TekalpICASSP 1997 · OpenReview

Abstract

This paper addresses 2-D mesh-based object tracking and mesh-based object mosaic construction for synthetic transfiguration of deformable video objects with deformable boundaries in the presence of another occluding object and/or self-occlusion. In particular, we update the 2-D triangular mesh model of a video object incrementally to account for the newly uncovered parts of the object as they are detected during the tracking process. Then, the minimum number of reference views (still images of a replacement object) needed to perform the synthetic transfiguration (object replacement and animation) is determined (depending on the complexity of the motion of the object-to-be-replaced), and the transfiguration of the replacement object is accomplished by 2-D mesh-based texture mapping in between these reference views. The proposed method is demonstrated by replacing an orange juice bottle by a cranberry juice bottle in a real video clip.
BibTeX
@inproceedings{toklu1997d,
  author = {Candemir Toklu and A. Tanju Erdem and A. Murat Tekalp},
  title = {{2-D mesh-based synthetic transfiguration of an object with occlusion}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {1997},
  url = {https://openreview.net/forum?id=GpNvQ3H2ci},
}

Loading related content...

Figure