FairJob: A Real-World Dataset for Fairness in Online Systems

Mariia Vladimirova, Federico Pavone, Eustache Diemert

TL;DR

This paper introduces FairJob, a novel real-world dataset for job recommendation advertising, designed to address the critical gap in fairness research for high-impact domains. It tackles the challenge of limited access to sensitive user attributes by proposing a gender proxy, enabling the study of algorithmic fairness in practical scenarios and offering a new benchmark for developing and evaluating bias mitigation techniques.

What Problem Does This Paper Address?

Algorithmic bias in online systems, particularly in advertising, can lead to unfair distribution of opportunities, such as job recommendations. While research in AI fairness has advanced, there's a significant lack of publicly available, realistic datasets for high-impact domains like advertising. This makes it difficult to rigorously study and develop effective bias mitigation strategies. A key challenge is the limited access to sensitive user attributes (like gender) due to privacy concerns and regulations. This paper addresses this by introducing the FairJob dataset, which is designed to be privacy-preserving while still enabling the study of fairness, and by proposing a method to derive a gender proxy from non-sensitive attributes.

Methods

The authors introduce the FairJob dataset, which is collected from a real-world job advertising campaign. To address privacy concerns, the dataset is anonymized, and feature names are obfuscated. Crucially, they propose a method to derive a gender proxy from user interaction data, allowing for fairness analysis without direct access to sensitive attributes. They also explore various stages of the advertising process where bias can be introduced and propose a method to compute a "fair utility metric" that accounts for selection bias in job recommendations. Finally, they conduct experimental evaluations of bias mitigation techniques on their dataset.

Datasets

The paper introduces the FairJob dataset, a new benchmark for fairness research in online advertising. This dataset contains pseudonymized user context and publisher features from a 5-month targeted job campaign. It includes 1,072,226 rows and 55 columns, with anonymized categorical and numerical features, a binary label for clicks, and a derived binary proxy for user gender. The dataset is available on Hugging Face.

Key Insights and Ideas

  • The "Proxy" Solution: The paper highlights that direct access to sensitive attributes like gender is often impossible in real-world scenarios. Their approach of using a derived gender proxy from observable user behavior is a practical way to enable fairness research in such constrained environments.
  • Fairness Across the Ad Pipeline: Bias isn't just in the final recommendation; it can creep in at multiple stages of the advertising process (campaign selection, bidding, recommendation). Understanding these stages is crucial for effective bias mitigation.
  • Balancing Utility and Fairness: The core challenge in advertising is not just fairness but also maintaining utility (e.g., clicks, conversions). The paper emphasizes the need for metrics and methods that can balance these competing objectives.
  • Real-World Data is Key: Abstract datasets are useful, but real-world data, with its inherent complexities and biases, is essential for developing robust and applicable fairness solutions.

Key Results

The paper demonstrates that their FairJob dataset can be used to evaluate bias mitigation techniques. Experimental evaluations showed potential improvements in fairness with associated trade-offs in utility. While specific quantitative results are detailed in the appendix and tables, the core finding is that their dataset enables the study of these trade-offs and the effectiveness of different fairness interventions in a realistic setting.

Limitations and Future Work

The authors acknowledge several limitations:

  • Gender Proxy Accuracy: The proposed gender proxy is derived from user behavior and may not perfectly correlate with actual gender. Verification of its accuracy is challenging.
  • Binary Gender Assumption: The proxy is binary, while gender is not necessarily binary.
  • Historical Bias: The dataset reflects historical biases present in the data, which are difficult to fully address.
  • Subjectivity of "Seniority": The "senior" job position label is derived from product titles and may have some subjectivity.
  • User Identification: While efforts are made to prevent re-identification, the possibility of multiple users sharing a device or a single user having multiple IDs across sessions is noted.

Future work could involve exploring other types of algorithmic discrimination beyond gender, developing better approximations for sensitive attributes, and investigating methods to improve worst-case performance for underrepresented groups even without direct demographic information.

Summary updated

Abstract

We introduce a fairness-aware dataset for job recommendations in advertising, designed to foster research in algorithmic fairness within real-world scenarios. It was collected and prepared to comply with privacy standards and business confidentiality. An additional challenge is the lack of access to protected user attributes such as gender, for which we propose a solution to obtain a proxy estimate. Despite being anonymized and including a proxy for a sensitive attribute, our dataset preserves predictive power and maintains a realistic and challenging benchmark. This dataset addresses a significant gap in the availability of fairness-focused resources for high-impact domains like advertising -- the actual impact being having access or not to precious employment opportunities, where balancing fairness and utility is a common industrial challenge. We also explore various stages in the advertising process where unfairness can occur and introduce a method to compute a fair utility metric for the job recommendations in online systems case from a biased dataset. Experimental evaluations of bias mitigation techniques on the released dataset demonstrate potential improvements in fairness and the associated trade-offs with utility. The dataset is hosted at https://huggingface.co/datasets/criteo/FairJob. Source code for the experiments is hosted at https://github.com/criteo-research/FairJob-dataset/.
BibTeX
@inproceedings{vladimirova2024fairjob,
  author = {Mariia Vladimirova and Federico Pavone and Eustache Diemert},
  title = {{FairJob: A Real-World Dataset for Fairness in Online Systems}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2024},
}
Figure