Towards Programming Multimodal Dialogues

Nieske L. Vergunst, Bas R. Steunebrink, Mehdi Dastani, F. P. M. Dignum, John-Jules Ch. MeyerWeb Intelligence/IAT Workshops 2007 · OpenReview

Abstract

This paper identifies several issues in multimodal dialogues between a companion robot and a human user. Specifically, these issues pertain to the synchronization of multimodal input and output, and the handling of expected and unexpected input, including input contradicting over different modalities. Furthermore, a novel way of visually representing multimodal dialogues is presented. Ultimately, this work represents some steps towards the development of a principled and generic method for programming multimodal dialogues.
BibTeX
@inproceedings{vergunst2007towards,
  author = {Nieske L. Vergunst and Bas R. Steunebrink and Mehdi Dastani and F. P. M. Dignum and John-Jules Ch. Meyer},
  title = {{Towards Programming Multimodal Dialogues}},
  booktitle = {Web Intelligence/IAT Workshops},
  year = {2007},
  url = {https://openreview.net/forum?id=LhSkFGT6Fz},
}

Loading related content...

Figure