Enforcing Delayed-Impact Fairness Guarantees

Aline Weber, Blossom Metevier, Yuriy Brun, Philip S. Thomas, Bruno Castro da Silva

Introduction

Traditional fairness research in machine learning has largely focused on static constraints—ensuring that a model's decisions at a single point in time do not discriminate against protected groups. However, as demonstrated by Liu et al. (2018), these "snapshot" fairness metrics can inadvertently lead to negative delayed impact (DI). For instance, a loan approval algorithm that satisfies demographic parity today might lead to higher default rates and lower credit scores for a disadvantaged group in the future, ultimately exacerbating social inequality.

Addressing delayed impact typically requires a precise analytical model of how current decisions influence future outcomes. In real-world scenarios, such models are rarely available. Researchers at UMass Amherst have introduced ELF (Enforcing Long-term Fairness), the first classification algorithm designed to provide high-confidence fairness guarantees for delayed impact in a "model-free" setting.

The ELF Framework

ELF treats fair classification as a hybrid between supervised learning and off-policy evaluation in Reinforcement Learning (RL). It is built upon the Seldonian optimization framework, which prioritizes safety by ensuring that any returned model satisfies user-defined constraints with high probability.

Key Components:

  1. Data Splitting: Historical data is divided into a candidate selection set for training and a safety test set for verification.
  2. Importance Sampling: To estimate the delayed impact of a new model using data generated by a previous "behavior" model, ELF employs importance sampling. This technique re-weights historical outcomes to provide an unbiased estimate of future performance without requiring a simulator.
  3. High-Confidence Bounds: Using statistical tools such as Student’s t-test or Hoeffding’s inequality, ELF calculates a high-confidence upper bound on the probability of unfairness. If the algorithm cannot guarantee that the model is fair with at least $(1-\delta)$ confidence, it returns "No Solution Found" rather than risking a harmful deployment.

Experimental Evaluation

The authors evaluated ELF using data from the U.S. Foster Care system, combining the AFCARS dataset (demographics and foster care history) with the NYTD dataset (outcomes for youth transitioning to adulthood). They focused on a synthetic DI metric related to employment outcomes to test the algorithm's robustness.

Results and Discussion

The experimental results highlight ELF's unique safety properties compared to standard fairness-aware and fairness-unaware baselines.

Failure rates of various algorithms for two delayed-impact constraints. ELF (red) consistently maintains a failure rate below the specified threshold (black line), whereas baseline methods frequently exceed it.

As shown in the figure above, popular toolkits like Fairlearn and standard Logistic Regression (LR) consistently fail to satisfy delayed-impact constraints, often exhibiting failure rates between 60% and 100%. In contrast, ELF’s failure rate remains strictly below the user-defined threshold $\delta$ across all experiments.

Accuracy and probability of returning a solution. ELF ensures safety by returning 'No Solution Found' when data is insufficient, eventually converging to high accuracy and solution probability as data increases.

Furthermore, ELF demonstrates a principled trade-off between safety and utility. In low-data regimes, ELF frequently returns "No Solution Found" because it cannot statistically prove the model's safety. As the amount of training data increases, the probability of returning a solution converges to 1, and the model's accuracy approaches that of state-of-the-art fairness-unaware methods.

Conclusion

ELF provides a robust path forward for deploying machine learning models in socially sensitive domains where long-term consequences are paramount. By leveraging off-policy evaluation and Seldonian optimization, it offers high-confidence guarantees without requiring perfect models of societal dynamics. Future work will address the challenges of non-stationary environments, where the relationship between decisions and impacts may evolve over time.

Summary updated

BibTeX
@inproceedings{weber2023enforcing,
  author = {Aline Weber and Blossom Metevier and Yuriy Brun and Philip S. Thomas and Bruno Castro da Silva},
  title = {{Enforcing Delayed-Impact Fairness Guarantees}},
  booktitle = {International Conference on Learning Representations},
  year = {2023},
  url = {https://openreview.net/forum?id=tgAI50giBbg},
}
Figure