Multimodal saliency-based attention for object-based scene analysis
Lists
Only you see this
Abstract
Multimodal attention is a key requirement for humanoid robots in order to navigate in complex environments and act as social, cognitive human partners. To this end, robots have to incorporate attention mechanisms that focus the processing on the potentially most relevant stimuli while controlling the sensor orientation to improve the perception of these stimuli. In this paper, we present our implementation of audio-visual saliency-based attention that we integrated in a system for knowledge-driven audio-visual scene analysis and object-based world modeling. For this purpose, we introduce a novel isophote-based method for proto-object segmentation of saliency maps, a surprise-based auditory saliency definition, and a parametric 3-D model for multimodal saliency fusion. The applicability of the proposed system is demonstrated in a series of experiments.
BibTeX
@inproceedings{schauerte2011multimodal,
author = {Boris Schauerte and Benjamin Kühn and Kristian Kroschel and Rainer Stiefelhagen},
title = {{Multimodal saliency-based attention for object-based scene analysis}},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
year = {2011},
doi = {10.1109/iros.2011.6095124},
}Loading related content...