Fair ranking: a critical review, challenges, and future directions
Lists
Only you see this
Abstract
Ranking, recommendation, and retrieval systems are widely used in online platforms and other societal systems, including e-commerce, media-streaming, admissions, gig platforms, and hiring. In the recent past, a large "fair ranking" research literature has been developed around making these systems fair to the individuals, providers, or content that are being ranked. Most of this literature defines fairness for a single instance of retrieval, or as a simple additive notion for multiple instances of retrievals over time. This work provides a critical overview of this literature, detailing the often context-specific concerns that such an approach misses: the gap between high ranking placements and true provider utility, spillovers and compounding effects over time, induced strategic incentives, and the effect of statistical uncertainty. We then provide a path forward for a more holistic and impact-oriented fair ranking research agenda, including methodological lessons from other fields and the role of the broader stakeholder community in overcoming data bottlenecks and designing effective regulatory environments.
BibTeX
@inproceedings{patro2022fair,
author = {Gourab K. Patro and Lorenzo Porcaro and Laura Mitchell and Qiuyue Zhang and Meike Zehlike and Nikhil Garg},
title = {{Fair ranking: a critical review, challenges, and future directions}},
booktitle = {FAccT},
year = {2022},
doi = {10.1145/3531146.3533238},
}