On the surplus value of semantic video analysis beyond the key frame

Cees G. M. Snoek, Marcel Worring, Jan-Mark Geusebroek, Dennis Koelma, Frank J. Seinstra

Abstract

Typical semantic video analysis methods aim for classification of camera shots based on extracted features from a single keyframe only. In this paper, we sketch a video analysis scenario and evaluate the benefit of analysis beyond the key frame for semantic concept detection performance. We developed detectors for a lexicon of 26 concepts, and evaluated their performance on 120 hours of video data. Results show that, on average, detection performance can increase with almost 40% when the analysis method takes more visual content into account.
BibTeX
@inproceedings{snoek2005surplus,
  author = {Cees G. M. Snoek and Marcel Worring and Jan-Mark Geusebroek and Dennis Koelma and Frank J. Seinstra},
  title = {{On the surplus value of semantic video analysis beyond the key frame}},
  booktitle = {ICME},
  year = {2005},
  doi = {10.1109/icme.2005.1521441},
}

Loading related content...

Figure