Are Humans Biased in Assessment of Video Interviews?
Lists
Only you see this
Abstract
Supervised systems require human labels for training. But, are humans themselves always impartial during the annotation process? We examine this question in the context of automated assessment of human behavioral tasks. Specifically, we investigate whether human ratings themselves can be trusted at their face value when scoring video-based structured interviews, and whether such ratings can impact machine learning models that use them as training data. We present preliminary empirical evidence that indicates there are biases in such annotations, most of which are visual in nature.
BibTeX
@inproceedings{leong2019are,
author = {Chee Wee Leong and Katrina Roohr and Vikram Ramanarayanan and Michelle P. Martin-Raugh and Harrison Kell and Rutuja Ubale and Yao Qian and Zydrune Mladineo and Laura McCulla},
title = {{Are Humans Biased in Assessment of Video Interviews?}},
booktitle = {ICMI (Adjunct)},
year = {2019},
url = {https://openreview.net/forum?id=WAhTi0gA_MH},
}Loading related content...