Cost-free Transfer Learning Mechanism: Deep Digging Relationships of Action Categories
Lists
Only you see this
Abstract
End-to-end deep learning for video action recognition is always a data-hungry task because training data with detailed annotations will never be sufficient for such a difficult problem. To fully explore the potential of existing labeled categories, we propose a new transfer learning mechanism deeply digging the local and global relationships between different action categories. As for local relation mining, a weakly-constrained hierarchy structure is built to prioritize the correlation for action pairs. And for global, the consistency of joint distribution of visual and semantic feature for all action categories is measured by the maximum mean discrepancy. As far as we know, this is the first time to explicitly explore the local and global relationships between video action categories. The experimental results show that the proposed relationships of action categories can improve the classification results on most representative models without any extra annotation. Surprisingly, the boost is even more obvious when the training samples are few. We achieve state-of-art experimental results on well-known datasets.
BibTeX
@inproceedings{wang2019cost,
author = {Wanneng Wang and Yanan Ma and Ke Gao and Juan Cao},
title = {{Cost-free Transfer Learning Mechanism: Deep Digging Relationships of Action Categories}},
booktitle = {ACM Multimedia},
year = {2019},
doi = {10.1145/3343031.3350884},
}Loading related content...