Automatic annotation of Web videos

Shih-Wei Sun, Yu-Chiang Frank Wang, Yao-Ling Hung, Chia-Ling Chang, Kuan-Chieh Chen, Shih-Sian Cheng, Hsin-Min Wang, Hong-Yuan Mark LiaoICME 2011 · OpenReview

Abstract

Most Web videos are captured in uncontrolled environments (e.g. videos captured by freely-moving cameras with low resolution); this makes automatic video annotation very difficult. To address this problem, we present a robust moving foreground object detection method followed by the integration of features collected from heterogeneous domains. We advance SIFT feature matching and present a probabilistic framework to construct consensus foreground object templates (CFOT). The CFOT can detect moving foreground objects of interest across video frames, and this allows us to extract visual features from foreground regions of interest. Together with the use of audio features, we are able to improve resulting annotation accuracy. We conduct experiments and achieve promising results on a Web video dataset collected from YouTube.
BibTeX
@inproceedings{sun2011automatic,
  author = {Shih-Wei Sun and Yu-Chiang Frank Wang and Yao-Ling Hung and Chia-Ling Chang and Kuan-Chieh Chen and Shih-Sian Cheng and Hsin-Min Wang and Hong-Yuan Mark Liao},
  title = {{Automatic annotation of Web videos}},
  booktitle = {ICME},
  year = {2011},
  url = {https://openreview.net/forum?id=xIDb048Rnx},
}

Loading related content...

Figure