Sample-Adapt Fusion Network for RGB-D Hand Detection in the Wild
Lists
Only you see this
Abstract
RGB and depth modalities provide complementary information, which can be effectively utilized to improve the performance of hand detection in the wild. Most existing fusion-based methods model the channel-wise or spatial-wise cross-modal correlation to exploit the complementary RGB-D information, in which the modeling operations are shared across all input samples. However, the input images show various modes due to the high diversity of scenes in the wild. This inter-sample variance cannot be effectively perceived by static modeling operations shared across all samples. To address this problem, we propose a Sample-Adapt Fusion Network (SAFNet) with Channel Dynamic Refinement Module (CDRM) and Spatial Dynamic Aggregation Module (SDAM) to adaptively model the channel-wise and spatial-wise cross-modal correlation. Specifically, we propose a Multi-kernel Attention Module (MAM) to individually generate attention maps for each input sample by applying learnable weighting operations to multiple convolutional kernels. Our method outperforms state-of-the-art methods on CUG Hand dataset.
BibTeX
@inproceedings{liu2023sample,
author = {Xingyu Liu and Pengfei Ren and Yuchen Chen and Cong Liu and Jing Wang and Haifeng Sun and Qi Qi and Jing-Yu Wang},
title = {{Sample-Adapt Fusion Network for RGB-D Hand Detection in the Wild}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2023},
doi = {10.1109/icassp49357.2023.10095106},
}Loading related content...