What You See Is What You Get? The Impact of Representation Criteria on Human Bias in Hiring

Andi Peng, Besmira Nushi, Emre Kiciman, Kori Inkpen, Siddharth Suri, Ece Kamar

Introduction

In the contemporary recruitment landscape, hiring is increasingly a "human-in-the-loop" process. While significant research has focused on mitigating algorithmic bias in the initial screening phases, the final selection often rests with a human recruiter. An algorithm may filter thousands of applicants to present a "slate" of top candidates, but the composition of this slate itself may influence human judgment. This paper investigates how "representation criteria"—the demographic balance of a candidate shortlist—affects human bias, specifically looking at whether balanced slates can counteract gender stereotypes in various professions.

The hiring pipeline illustrating the transition from world distribution to final hiring recommendations, highlighting the points where societal, algorithmic, and human biases manifest.

Methodology

The researchers conducted a large-scale controlled experiment involving over 4,900 participants on Amazon Mechanical Turk. They developed synthetic candidate profiles for 14 diverse professions, ranging from plumbing to medicine. To isolate gender bias, candidate qualifications such as education and experience were held constant, while names and pronouns were randomized to signal gender.

The primary intervention involved varying the "representation criteria" on the candidate slate, presenting participants with shortlists that were 25%, 50%, or 75% female. To quantify bias, the authors compared human selection patterns against a hypergeometric distribution, which represents the expected outcome of an unbiased selection process based purely on equalized qualifications. These results were further benchmarked against real-world gender distributions (US Census and BLS data) and AI-driven professional gender associations (word2vec embeddings).

Key Findings

The Efficacy of Balanced Slates

For many professions characterized by significant real-world gender skews, such as software engineering (19% female) or plumbing, the introduction of a 50/50 gender-balanced slate was remarkably effective. In these instances, human decision-makers selected candidates at rates closely aligning with the balanced representation on the slate, suggesting that bias in these fields is largely a "representation problem" that can be mitigated through diverse shortlisting.

Persistent Human Preferences

Conversely, certain roles exhibited "persistent" biases that resisted intervention. In professions like nursing, nanny services, and OBGYN, human preferences for female candidates remained significantly higher than statistical expectations, even when slates were heavily skewed or balanced. For example, in OBGYN hiring, a 50/50 slate still resulted in a 60% selection rate for women ($p < 0.000$), indicating deep-seated societal associations that transcend simple representation.

Probability Mass Functions (PMFs) for OBGYN and Software Engineering roles across different representation levels, comparing expected distributions with observed selections by male and female decision-makers.

The Role of Decision-Maker Identity

The study also revealed that bias is not uniform across recruiters. In several cases, male and female decision-makers displayed opposing biases. Notably, the pro-female bias observed in OBGYN hiring was primarily driven by female recruiters. Furthermore, the complexity of the task influenced the manifestation of bias; while participants were generally objective when selecting a single top candidate, gender-based heuristics became more prominent during more complex tasks, such as ranking a "Top 4" list.

Discussion and Conclusion

The findings suggest that while algorithmic interventions to balance candidate slates can effectively "correct" world-view biases in many technical and trade professions, they are not a panacea. Persistent human preferences in specific care-oriented or gender-associated roles remain a challenge.

The study is limited by its focus on binary gender and the use of a synthetic experimental environment. In the real world, achieving 50/50 slates may be constrained by the "pipeline problem"—the actual availability of qualified candidates in highly skewed fields. Future research should explore intersectional biases involving race and age, and investigate how these representation dynamics play out among professional HR recruiters in high-stakes environments. Ultimately, the research highlights that "human-in-the-loop" fairness requires a nuanced understanding of how slate composition interacts with ingrained human heuristics.

Summary updated

BibTeX
@inproceedings{peng2019what,
  author = {Andi Peng and Besmira Nushi and Emre Kiciman and Kori Inkpen and Siddharth Suri and Ece Kamar},
  title = {{What You See Is What You Get? The Impact of Representation Criteria on Human Bias in Hiring}},
  booktitle = {HCOMP},
  year = {2019},
  doi = {10.1609/hcomp.v7i1.5281},
}
Figure