Assessing the Value of Multimodal Interfaces: A Study on Human-Machine Interaction in Weld Inspection Workstations

Paul Chojecki, Dominykas Strazdas, David Przewozny, Niklas Gard, Detlef Runde, Niklas Hoerner, Ayoub Al-Hamadi, Peter Eisert, Sebastian Bosse

Abstract

Multimodal user interfaces promise a natural and intuitive human machine interactions. But is the extra effort for the development of a complex multi-sensor system justified, or can users also be satisfied with one input modality already? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction with buttons augmented on a workpiece or a worktable, and speech commands, were tested individually and in a multimodal combination. Within the unimodal conditions, users preferred the augmented worktable, but overall, the interindividual usage of all input technologies in the multimodal condition was ranked best. Our findings indicate that the implementation and use of multiple input modalities is valuable, and that it is difficult to predict the usability of individual input modalities for complex systems.
BibTeX
@inproceedings{chojecki2023assessing,
  author = {Paul Chojecki and Dominykas Strazdas and David Przewozny and Niklas Gard and Detlef Runde and Niklas Hoerner and Ayoub Al-Hamadi and Peter Eisert and Sebastian Bosse},
  title = {{Assessing the Value of Multimodal Interfaces: A Study on Human-Machine Interaction in Weld Inspection Workstations}},
  booktitle = {Sensors},
  year = {2023},
  url = {https://openreview.net/forum?id=cukzUxeZQ7},
}

Loading related content...

Figure