Abstraction hierarchy and self annotation update for fine grained activity recognition

Song Cao, Kan Chen, Ram NevatiaWACV 2016 · OpenReview

Abstract

Fine-grained activity recognition focuses recognition on sub-ordinate levels. This task is made difficult due to low inter-class variability and high intra-class variability caused by human motion and objects. We propose that recognition of such activities can be significantly improved by grouping and decomposing them into a hierarchy of multiple abstraction layers; we introduce a Hierarchical Activity Network (HAN). Recognition in HAN is guided by classifiers operating at multiple levels; furthermore, descriptions of different levels of abstraction are also generated from HAN, which may be useful for different tasks. We show significant improvements in accuracy of recognition compared to earlier methods. Besides, annotation for fine grained activity is challenging, and inaccurate annotation influences classification performance. We explore an automatic solution for improving the classification results while auto enhancing the annotation quality.
BibTeX
@inproceedings{cao2016abstraction,
  author = {Song Cao and Kan Chen and Ram Nevatia},
  title = {{Abstraction hierarchy and self annotation update for fine grained activity recognition}},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year = {2016},
  url = {https://openreview.net/forum?id=o_Zzuf656pCL},
}

Loading related content...

Figure