Attentional Fused Temporal Transformation Network for Video Action Recognition
Lists
Only you see this
Abstract
Effective spatiotemporal feature representation is crucial to the video-based action recognition task. Focusing on discriminate spatiotemporal feature learning, we propose Attentional Fused Temporal Transformation Network (AttnTTN) for action recognition on top of popular Temporal Segment Network (TSN) framework. In the network, Attentional Fusion Module (AttnFM) is designed to fuse the appearance and motion features at multiple ConvNet levels for each video snippet, forming a short-term video descriptor. With fused features as inputs, Temporal Transformation Networks (TTN) are employed to model middle-term temporal transformation between the neighboring temporal snippets following a sequential order. AttnTTN achieves the state-of-the-art results on two most popular action recognition datasets: UCF101 and HMDB51.
BibTeX
@inproceedings{yang2020attentional,
author = {Ke Yang and Zhiyuan Wang and Huadong Dai and Tianlong Shen and Peng Qiao and Xin Niu and Jie Jiang and Dongsheng Li and Yong Dou},
title = {{Attentional Fused Temporal Transformation Network for Video Action Recognition}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2020},
doi = {10.1109/icassp40776.2020.9053394},
}Loading related content...