Mini-crowdsourcing end-user assessment of intelligent assistants: A cost-benefit study
Lists
Only you see this
Abstract
Intelligent assistants sometimes handle tasks too important to be trusted implicitly. End users can establish trust via systematic assessment, but such assessment is costly. This paper investigates whether, when, and how bringing a small crowd of end users to bear on the assessment of an intelligent assistant is useful from a cost/benefit perspective. Our results show that a mini-crowd of testers supplied many more benefits than the obvious decrease in workload, but these benefits did not scale linearly as mini-crowd size increased - there was a point of diminishing returns where the cost-benefit ratio became less attractive.
BibTeX
@inproceedings{shinsel2011mini,
author = {Amber Shinsel and Todd Kulesza and Margaret M. Burnett and William Curran and Alex Groce and Simone Stumpf and Weng-Keen Wong},
title = {{Mini-crowdsourcing end-user assessment of intelligent assistants: A cost-benefit study}},
booktitle = {VL/HCC},
year = {2011},
url = {https://openreview.net/forum?id=ZkIsbcbIa_V},
}Loading related content...