Understanding and classifying image tweets

Tao Chen, Dongyuan Lu, Min-Yen Kan, Peng Cui

Abstract

Social media platforms now allow users to share images alongside their textual posts. These image tweets make up a fast-growing percentage of tweets, but have not been studied in depth unlike their text-only counterparts. We study a large corpus of image tweets in order to uncover what people post about and the correlation between the tweet's image and its text. We show that an important functional distinction is between visually-relevant and visually-irrelevant tweets, and that we can successfully build an automated classifier utilizing text, image and social context features to distinguish these two classes, obtaining a macro F1 of 70.5%.
BibTeX
@inproceedings{chen2013understanding,
  author = {Tao Chen and Dongyuan Lu and Min-Yen Kan and Peng Cui},
  title = {{Understanding and classifying image tweets}},
  booktitle = {ACM Multimedia},
  year = {2013},
  doi = {10.1145/2502081.2502203},
}

Loading related content...

Figure