Putting the pieces together: multimodal analysis of social attention in meetings

Subramanian Ramanathan, Jacopo Staiano, Kyriaki Kalimeri, Nicu Sebe, Fabio Pianesi

Abstract

This paper presents a multimodal framework employing eye-gaze, head-pose and speech cues to explain observed social attention patterns in meeting scenes. We first investigate a few hypotheses concerning social attention and characterize meetings and individuals based on ground-truth data. This is followed by replication of ground-truth results through automated estimation of eye-gaze, head-pose and speech activity for each participant. Experimental results show that combining eye-gaze and head-pose estimates decreases error in social attention estimation by over 26%.
BibTeX
@inproceedings{ramanathan2010putting,
  author = {Subramanian Ramanathan and Jacopo Staiano and Kyriaki Kalimeri and Nicu Sebe and Fabio Pianesi},
  title = {{Putting the pieces together: multimodal analysis of social attention in meetings}},
  booktitle = {ACM Multimedia},
  year = {2010},
  doi = {10.1145/1873951.1874045},
}

Loading related content...

Figure