Modeling facial expressions and peripheral physiological signals to predict topical relevance

Ioannis Arapakis, Ioannis Konstas, Joemon M. Jose, Ioannis Kompatsiaris

Abstract

By analyzing explicit & implicit feedback information retrieval systems can determine topical relevance and tailor search criteria to the user's needs. In this paper we investigate whether it is possible to infer what is relevant by observing user affective behaviour. The sensory data employed range between facial expressions and peripheral physiological signals. We extract a set of features from the signals and analyze the data using classification methods, such as SVM and KNN. The results of our initial evaluation indicate that prediction of relevance is possible, to a certain extent, and implicit feedback models can benefit from taking into account user affective behavior.
BibTeX
@inproceedings{arapakis2009modeling,
  author = {Ioannis Arapakis and Ioannis Konstas and Joemon M. Jose and Ioannis Kompatsiaris},
  title = {{Modeling facial expressions and peripheral physiological signals to predict topical relevance}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2009},
  doi = {10.1145/1571941.1572099},
}

Loading related content...

Figure