Video completion via motion guided spatial-temporal global optimization

Ming Liu, Shifeng Chen, Jianzhuang Liu, Xiaoou Tang

Abstract

In this paper, a novel global optimization based approach is proposed for video completion whose target is to restore the spatial-temporal missing regions of a video in a visually plausible way. Our algorithm consists of two stages: motion field completion and color completion via global optimization. First, local motions within the missing parts are completed patch-by-patch greedily using pre-computed available motions in the video. Then the missing regions are filled by sampling patches from available parts of the video. We formulate the video completion as a global energy minimization problem by Markov random fields (MRFs). Based on the completed motion field of the video, a well-defined energy function involving both spatial and temporal coherence relationship is constructed. A coarse-to-fine Belief Propagation (BP) is proposed to solve the optimization problem. Experimental results have demonstrated the good performance of our algorithm.
BibTeX
@inproceedings{liu2009video,
  author = {Ming Liu and Shifeng Chen and Jianzhuang Liu and Xiaoou Tang},
  title = {{Video completion via motion guided spatial-temporal global optimization}},
  booktitle = {ACM Multimedia},
  year = {2009},
  doi = {10.1145/1631272.1631350},
}

Loading related content...

Figure