Showcasing Deeply Supervised Multimodal Attentional Translation Embeddings: a Demo for Visual Relationship Detection

Nikolaos Gkanatsios, Vassilis Pitsikalis, Petros Koutras, Athanasia Zlatintsi, Petros MaragosICIP 2019 · OpenReview

Abstract

We address the task of Visual Relationship Detection, i.e. the detection of <; Subject, Predicate, Object> triplets in an image, introducing Multimodal Attentional Translation Embeddings (ICIP 2019 paper, id 3642). Motivated by the need of visualization and interpretation of the results, as well as the lack of other tools for online predictions on this task, we design and implement the first architecture for live inference of visual relationships on video streams and wild images, including research and engineering extensions, ablation models and a lightweight CPU-version. The code is available at https://bitbucket.org/deeplabai/vrd.
BibTeX
@inproceedings{gkanatsios2019showcasing,
  author = {Nikolaos Gkanatsios and Vassilis Pitsikalis and Petros Koutras and Athanasia Zlatintsi and Petros Maragos},
  title = {{Showcasing Deeply Supervised Multimodal Attentional Translation Embeddings: a Demo for Visual Relationship Detection}},
  booktitle = {ICIP},
  year = {2019},
  url = {https://openreview.net/forum?id=jUtSqSUnfz},
}

Loading related content...

Figure