Automatic sentence generation from images

Yoshitaka Ushiku, Tatsuya Harada, Yasuo KuniyoshiACM Multimedia 2011 · OpenReview

Abstract

For the overwhelming amounts of multimedia used on the Web, methods of search and understanding with sentences are necessary. Representing the contents not only using labels but also using sentences including labels' relations enables users to search with a story and to understand multimedia deeply. However, few existing works describe such sentences because obtaining objects' relations and grammar is difficult. We specifically examine captions of images that are similar to an input image. They are expected to explain the input image to some degree. Therefore, we propose a novel approach to generate a sentential caption for the input image by summarizing those captions. Our experiment using a dataset consisting of images and text demonstrates that the proposed method can generate sentential captions.
BibTeX
@inproceedings{ushiku2011automatic,
  author = {Yoshitaka Ushiku and Tatsuya Harada and Yasuo Kuniyoshi},
  title = {{Automatic sentence generation from images}},
  booktitle = {ACM Multimedia},
  year = {2011},
  url = {https://openreview.net/forum?id=yx9fjKo23i6},
}

Loading related content...

Figure