Unveiling hierarchical relationships for social image representation learning

Linfeng Han, Xiaoming Zhang, Litian Zhang, Ming Lu, Feiran Huang, Yun Liu

Abstract

Highlights•Social images have multimodal properties, encompassing visual content, textual descriptions, and social relationships.•There is a hierarchical relationship between content within individual images and the social relationships among different images.•We propose a novel Hierarchical Heterogeneous Graph Neural Network to exploit the hierarchical relationship between diverse modalities.•Our approach can capture fine-grained correlation within the image and heterogeneous relationships among the images.•Experimental results demonstrate the superiority of our proposal for networkoriented multimodal tasks.
BibTeX
@article{han2023unveiling,
  author = {Linfeng Han and Xiaoming Zhang and Litian Zhang and Ming Lu and Feiran Huang and Yun Liu},
  title = {{Unveiling hierarchical relationships for social image representation learning}},
  journal = {Applied Soft Computing},
  year = {2023},
  doi = {10.1016/j.asoc.2023.110792},
}

Loading related content...

Figure