Data-Aware Proxy Hashing for Cross-modal Retrieval
Lists
Only you see this
Abstract
Recently, numerous proxy hash code based methods, which sufficiently exploit the label information of data to supervise the training of hashing models, have been proposed. Although these methods have made impressive progress, their generating processes of proxy hash codes are based only on the class information of the dataset or labels of data but do not take the data themselves into account. Therefore, these methods will probably generate some inappropriate proxy hash codes, thus damaging the retrieval performance of the hash models. To solve the aforementioned problem, we propose a novel Data-Aware Proxy Hashing for cross-modal retrieval, called DAPH. Specifically, our proposed method first train a data-aware proxy network that takes the data points, label vectors of data, and the class vectors of the dataset as inputs to generate class-based data-aware proxy hash codes, label-fused image-aware proxy hash codes and label-fused text-aware proxy hash codes. Then, we propose a novel hash loss that exploits the three types of data-aware proxy hash codes to supervise the training of modality-specific hashing networks. After training, DAPH is able to generate discriminate hash codes with the semantic information preserved adequately. Extensive experiments on three benchmark datasets show that the proposed DAPH outperforms the state-of-the-art baselines in cross-modal retrieval tasks.
BibTeX
@inproceedings{tu2023data,
author = {Rong-Cheng Tu and Xian-Ling Mao and Wenjin Ji and Wei Wei and Heyan Huang},
title = {{Data-Aware Proxy Hashing for Cross-modal Retrieval}},
booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
year = {2023},
doi = {10.1145/3539618.3591660},
}Loading related content...