Multi-Graph Based Hierarchical Semantic Fusion for Cross-Modal Representation
Lists
Only you see this
Abstract
The main challenge of cross-modal retrieval is how to efficiently realize semantic alignment and reduce the heterogeneity gap. However, existing approaches ignore the multi-grained semantic knowledge learning from different modalities. To this end, this paper proposes a novel end-to-end cross-modal representation method, termed as Multi-Graph based Hierarchical Semantic Fusion (MG-HSF). This method is an integration of multi-graph hierarchical semantic fusion with cross-modal adversarial learning, which captures fine-grained and coarse-grained semantic knowledge from cross-modal samples, and generate modalities-invariant representations in a common subspace. To evaluate the performance, extensive experiments are conducted on three benchmarks. The experimental results show that our method is superior than the state-of-the-arts.
BibTeX
@inproceedings{zhu2021multi,
author = {Lei Zhu and Chengyuan Zhang and Jiayu Song and Liangchen Liu and Shichao Zhang and Yangding Li},
title = {{Multi-Graph Based Hierarchical Semantic Fusion for Cross-Modal Representation}},
booktitle = {ICME},
year = {2021},
url = {https://openreview.net/forum?id=0EPtXC-pcf},
}Loading related content...