A computer vision integration model for a multi-modal cognitive system

Alen Vrecko, Danijel Skocaj, Nick Hawes, Ales Leonardis

Abstract

We present a general method for integrating visual components into a multi-modal cognitive system. The integration is very generic and can work with an arbitrary set of modalities. We illustrate our integration approach with a specific instantiation of the architecture schema that focuses on integration of vision and language: a cognitive system able to collaborate with a human, learn and display some understanding of its surroundings. As examples of cross-modal interaction we describe mechanisms for clarification and visual learning.
BibTeX
@inproceedings{vrecko2009computer,
  author = {Alen Vrecko and Danijel Skocaj and Nick Hawes and Ales Leonardis},
  title = {{A computer vision integration model for a multi-modal cognitive system}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2009},
  doi = {10.1109/iros.2009.5354358},
}

Loading related content...

Figure