Group Fairness in Prediction-Based Decision Making: From Moral Assessment to Implementation

Joachim Baumann, Joachim Baumann 0002, Christoph Heitz

TL;DR

This paper proposes a comprehensive, step-by-step framework for building fair prediction-based decision-making systems. It bridges the gap between abstract ethical principles and concrete algorithmic implementations by providing a structured approach to morally assessing fairness, selecting appropriate statistical criteria, and integrating them into optimal decision rules.

What Problem Does This Paper Address?

As machine learning models increasingly automate critical decisions (e.g., loan applications, hiring, criminal justice), ensuring fairness becomes paramount. While numerous statistical fairness criteria exist, choosing the morally appropriate one for a given context is challenging. This paper addresses the disconnect between ethical considerations and practical implementation by offering a systematic procedure to guide practitioners through the complex process of defining, selecting, and enforcing group fairness in prediction-based systems. It tackles the difficulty of translating abstract notions of justice into measurable and actionable fairness constraints within algorithmic decision-making.

Methods

The core contribution is a three-step procedure:

  1. Moral Assessment of Fairness: This step leverages the "Fair Equality of Chances" (FEC) principle, which defines fairness based on three moral categories: the benefit (UDS) being distributed, the groups (G) being compared, and the justifier (J) that might morally permit unequal distributions. This framework helps users define what fairness means in their specific context.
  2. Mapping to Statistical Fairness Criteria: The moral assessment results are then mapped to established statistical group fairness criteria (e.g., independence, separation, sufficiency). The paper extends the FEC principle to cover all these criteria and introduces an "Extended FEC" (E-FEC) to account for morally irrelevant aspects of the justifier, leading to relaxations of fairness criteria.
  3. Implementation in Optimal Decision Making: Finally, the paper outlines how to integrate the chosen fairness criterion into an optimal decision rule. This involves formulating fairness as a constrained optimization problem, maximizing decision-maker utility while satisfying the fairness constraint. The paper discusses techniques for balancing the inherent tradeoff between performance and fairness, including partial fulfillment of fairness constraints.

Datasets

The paper uses the ProPublica recidivism dataset, specifically the COMPAS tool data, for its application example. This dataset is used to train a logistic regression model to predict recidivism risk scores. The authors note they used a pre-processed version of this dataset available online.

Key Insights and Ideas

  • Bridging Ethics and Code: The paper provides a concrete, actionable framework that connects abstract ethical principles of fairness to practical, implementable statistical criteria and algorithmic solutions.
  • FEC as a Unifying Principle: The FEC principle, and its extension (E-FEC), is shown to be a powerful tool for morally justifying a wide range of group fairness criteria, not just a subset as previously thought.
  • Morally Irrelevant Justifiers Matter: Recognizing that not all aspects of a "justifier" are morally relevant for fairness is crucial. The E-FEC principle allows for relaxations of fairness constraints when certain aspects of the justifier are deemed irrelevant, leading to more practical fairness implementations.
  • Context is King: The paper strongly emphasizes that the choice of fairness criteria is highly context-dependent and requires a thorough ethical analysis of the specific application.
  • Performance-Fairness Tradeoff is Quantifiable: The framework allows for the explicit visualization and management of the tradeoff between decision-maker utility and fairness, enabling informed decisions about the degree of fairness to enforce.

Key Results

The paper demonstrates its framework through an application to jail-or-release decisions.

  • FPR Parity as Appropriate: For the recidivism example, the moral assessment leads to FPR (False Positive Rate) parity as the appropriate fairness criterion, arguing that the harm of wrongly detaining innocent individuals is a fairness concern, while the harm of wrongly releasing those who reoffend is morally irrelevant.
  • Tradeoff Visualization: Figure 2b visually represents the performance-fairness tradeoff, showing that enforcing FPR parity (dfair) results in a slight decrease in decision-maker utility (0.662 vs. 0.668 for unconstrained dunconstrained) but achieves equal FPR across racial groups.
  • Group-Specific Thresholds: The implementation results in group-specific decision thresholds, leading to fewer detained African Americans and more detained Caucasians compared to an unconstrained model.

Limitations and Future Work

  • Moral Assessment is Subjective: The authors acknowledge that the formalization of the moral assessment does not dictate the outcome. The definition of benefit, groups, and justifiers depends on the context and the moral stances of stakeholders, which can lead to disagreements.
  • Future Work: The paper suggests that further work could explore different utility functions and their impact on the fairness-performance tradeoff. It also implies that extending the framework to other types of fairness (e.g., individual fairness) or more complex decision systems could be valuable.

Summary updated

Abstract

Ensuring fairness of prediction-based decision making is based on statistical group fairness criteria. Which one of these criteria is the morally most appropriate one depends on the context, and its choice requires an ethical analysis. In this paper, we present a step-by-step procedure integrating three elements: (a) a framework for the moral assessment of what fairness means in a given context, based on the recently proposed general principle of "Fair equality of chances" (FEC) (b) a mapping of the assessment's results to established statistical group fairness criteria, and (c) a method for integrating the thus-defined fairness into optimal decision making. As a second contribution, we show new applications of the FEC principle and show that, with this extension, the FEC framework covers all types of group fairness criteria: independence, separation, and sufficiency. Third, we introduce an extended version of the FEC principle, which additionally allows accounting for morally irrelevant elements of the fairness assessment and links to well-known relaxations of the fairness criteria. This paper presents a framework to develop fair decision systems in a conceptually sound way, combining the moral and the computational elements of fair prediction-based decision-making in an integrated approach. Data and code to reproduce our results are available at https://github.com/joebaumann/fair-prediction-based-decision-making.
BibTeX
@inproceedings{baumann2022group,
  author = {Joachim Baumann and Joachim Baumann and Christoph Heitz},
  title = {{Group Fairness in Prediction-Based Decision Making: From Moral Assessment to Implementation}},
  booktitle = {Sds},
  year = {2022},
  doi = {10.1109/sds54800.2022.00011},
}
Figure