View-Invariant Human Action Recognition Via View Transformation Network (VTN)
Lists
Only you see this
Abstract
Since the human body is non-rigid, actions captured in different views always involve action occlusion and information loss. Recently, view-variation-related human action recognition is still a challenging problem. To address the problem, we propose a View Transformation Network (VTN) that realizes the view normalization by transforming arbitrary-view action samples to a base view to seek for a view-invariant representation. an attention learning module is designed to learn a co-attention for action samples of different views, that contributes to output a similar feature representation to erase the view diversity in different views. Extensive and fair evaluations are performed on the UESTC varying-view RGB-D dataset, the NTU RGB-D 60 dataset, and the NTU RGB-D 120 dataset, where three evaluation types, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">i.e.</i> X-subject, X-view, and A-view recognition, are performed. Experiments illustrate that our VTN model achieves outstanding performance.
BibTeX
@article{gao2022view,
author = {Lingling Gao and Yanli Ji and Kumie Gedamu and Xiaofeng Zhu and Xing Xu and Heng Tao Shen},
title = {{View-Invariant Human Action Recognition Via View Transformation Network (VTN)}},
journal = {IEEE Trans. Multimedia},
year = {2022},
url = {https://openreview.net/forum?id=tlmEZa_i8H},
}Loading related content...