Bag of Spatio-temporal Synonym Sets for Human Action Recognition

Lin Pang, Juan Cao, Junbo Guo, Shouxun Lin, Yan Song

Abstract

Recently, bag of spatio-temporal local features based methods have received significant attention in human action recognition. However, it remains a big challenge to overcome intra-class variations in cases of viewpoint, geometric and illumination variance. In this paper we present Bag of Spatio-temporal Synonym Sets (ST-SynSets) to represent human actions, which can partially bridge the semantic gap between visual appearances and category semantics. Firstly, it re-clusters the original visual words into a higher level ST-SynSet based on the distribution consistency among different action categories using Information Bottleneck clustering method. Secondly, it adaptively learns a distance metric with both the visual and semantic constraints for ST-SynSets projection. Experiments and comparison with state-of-art methods show the effectiveness and robustness of the proposed method for human action recognition, especially in multiple viewpoints and illumination conditions.
BibTeX
@inproceedings{pang2010bag,
  author = {Lin Pang and Juan Cao and Junbo Guo and Shouxun Lin and Yan Song},
  title = {{Bag of Spatio-temporal Synonym Sets for Human Action Recognition}},
  booktitle = {MMM},
  year = {2010},
  doi = {10.1007/978-3-642-11301-7\_43},
}

Loading related content...

Figure