Recognizing Activities via Bag of Words for Attribute Dynamics

Weixin Li, Qian Yu, Harpreet S. Sawhney, Nuno Vasconcelos

Abstract

In this work, we propose a novel video representation for activity recognition that models video dynamics with attributes of activities. A video sequence is decomposed into short-term segments, which are characterized by the dynamics of their attributes. These segments are modeled by a dictionary of attribute dynamics templates, which are implemented by a recently introduced generative model, the binary dynamic system~(BDS). We propose methods for learning a dictionary of BDSs from a training corpus, and for quantizing attribute sequences extracted from videos into these BDS code words. This procedure produces a representation of the video as a histogram of BDS code words, which is denoted the bag-of-words for attribute dynamics (BoWAD). An extensive experimental evaluation reveals that this representation outperforms other state-of-the-art approaches in temporal structure modeling for complex activity recognition.
BibTeX
@inproceedings{li2013recognizing,
  author = {Weixin Li and Qian Yu and Harpreet S. Sawhney and Nuno Vasconcelos},
  title = {{Recognizing Activities via Bag of Words for Attribute Dynamics}},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year = {2013},
  doi = {10.1109/cvpr.2013.334},
}
Figure