How to Find Interesting Locations in Video: A Spatiotemporal Interest Point Detector Learned from Human Eye Movements

Wolf Kienzle, Bernhard Schölkopf, Felix A. Wichmann, Matthias O. Franz

Abstract

Interest point detection in still images is a well-studied topic in computer vision. In the spatiotemporal domain, however, it is still unclear which features indicate useful interest points. In this paper we approach the problem by learning a detector from examples: we record eye movements of human subjects watching video sequences and train a neural network to predict which locations are likely to become eye movement targets. We show that our detector outperforms current spatiotemporal interest point architectures on a standard classification dataset.
BibTeX
@inproceedings{kienzle2007how,
  author = {Wolf Kienzle and Bernhard Schölkopf and Felix A. Wichmann and Matthias O. Franz},
  title = {{How to Find Interesting Locations in Video: A Spatiotemporal Interest Point Detector Learned from Human Eye Movements}},
  booktitle = {DAGM-Symposium},
  year = {2007},
  doi = {10.1007/978-3-540-74936-3\_41},
}

Loading related content...

Figure