Automatic salient object sequence rebuilding for video segment analysis

Tie Liu, Haibin Duan, Yuanyuan Shang, Zejian Yuan, Nanning Zheng

Abstract

Detection of salient object sequences from video data is challenging when the salient object changes between consecutive frames. In this study, we addressed the salient object sequence rebuilding problem with video segment analysis. We reformulated the problem as a binary labeling problem, analyzed the potential salient object sequences in the video using a clustering method, and separated the salient object sequence from the background by applying an energy optimization method. Our proposed approach determines whether temporal consecutive pixels belong to the same salient object sequence. The conditional random field is then learned to effectively integrate the salient features and the sequence consecutive constraints. A dynamic programming algorithm was developed to resolve the energy minimization problem efficiently. Experimental results confirmed the ability of our approach to address the salient object rebuilding problem in automatic visual attention applications and video content analysis.
BibTeX
@article{liu2018automatic,
  author = {Tie Liu and Haibin Duan and Yuanyuan Shang and Zejian Yuan and Nanning Zheng},
  title = {{Automatic salient object sequence rebuilding for video segment analysis}},
  journal = {Science China Information Sciences},
  year = {2018},
  url = {https://openreview.net/forum?id=Riwdd4Uinu},
}

Loading related content...

Figure