Towards Stable Preferences for Stakeholder-aligned Machine Learning

Haleema Sheraz, Stefan C. Kremer, Joshua August Skorburg, Graham W. Taylor, Walter Sinnott‐Armstrong, Kyle Boerstler

TL;DR

This paper tackles the challenge of ethically allocating scarce kidneys by developing machine learning models that learn individual and group preferences. They introduce a novel "stability-level" model that accounts for how consistent a person's preferences are over time, finding that while individual-level models generally perform best, stable preferences can still improve overall model performance.

What Problem Does This Paper Address?

The demand for kidneys far outstrips the supply, creating a critical need for fair and efficient allocation systems. While algorithms exist to optimize transplants, a fundamental challenge is the lack of consensus on what constitutes "morally relevant" factors in allocation. Different stakeholders (patients, doctors, society) may have varying, and sometimes conflicting, views on criteria like age, health, or even lifestyle choices. This paper aims to bridge this gap by developing a data-driven method to learn and incorporate these diverse stakeholder preferences into kidney allocation decisions, moving towards more transparent and equitable practices.

Methods

The researchers developed three distinct machine learning models to predict preferences for kidney allocation:

  • Individual-Level Model: This model predicts preferences for each participant individually. This means a separate model is trained for each person in the dataset.
  • Group-Level Model: This model aggregates preferences from all participants to make predictions for the group as a whole, using a single model.
  • Stability-Level Model: This is the paper's novel contribution. It's an extension of the group-level model that specifically incorporates the stability of a participant's preferences. Stability is defined as how consistently a participant makes the same allocation decision when presented with the same patient characteristics over time.

All three model types were trained using three classification algorithms: XGBoost, Random Forest, and Multi-layer Perceptron (MLP). Data preprocessing involved removing participants with insufficient responses and those who failed attention checks. A standard 80/20 train-test split was used, with stratification to ensure proportional data distribution. Performance was evaluated using accuracy, F1 score, and Area Under the Curve (AUC).

Datasets

The study utilized two datasets derived from the 'Pairwise Kidney Patient Online Survey for Individual Modeling' experiment conducted by the Moral AI group at Duke University.

  • Dataset 1 (DT1): This dataset contained data from 30 participants.
  • Dataset 2 (DT2): This dataset contained data from 80 participants.

Participants in the survey were presented with hypothetical scenarios involving two potential kidney recipients and had to choose which one should receive the organ. They completed multiple sessions over two weeks to capture evolving or stable preferences. The datasets included various patient attributes (e.g., age, dependents, lifestyle factors) and participant response times.

Key Insights and Ideas

  • Individual Preferences Matter Most: The individual-level models consistently outperformed both the group-level and stability-level models across all metrics and classifiers. This suggests that capturing each person's unique decision-making logic is crucial for accurate preference prediction.
  • Stability Can Help: Despite the individual models' superiority, the stability-level model showed promise, particularly with XGBoost and MLP classifiers. This indicates that accounting for how consistent a person's preferences are can still yield valuable insights and potentially improve model performance, especially when individual preferences are highly variable.
  • The Dynamic Nature of Preferences: The paper highlights that human preferences are not static. The variability observed, especially in Dataset 2, underscores the dynamic and diverse nature of human decision-making, which can change over time.
  • Ethical Integration is Key: The research emphasizes the importance of integrating moral values and stakeholder preferences into algorithmic decision-making, particularly in sensitive domains like organ allocation, to ensure fairness and transparency.

Key Results

  • Individual-Level Dominance: Across both datasets (DT1 and DT2) and all three classifiers (XGBoost, Random Forest, MLP), the individual-level models achieved the highest accuracy, F1 scores, and AUC values. For example, in DT1, individual-level accuracy ranged from 91.49% to 91.93%, consistently higher than group or stability models.
  • Stability Model Performance: The stability-level model, while generally underperforming the individual-level model, still showed strong results, especially with XGBoost and MLP. For instance, in DT1, stability-level AUC with XGBoost was 91.75%, close to the individual-level AUC of 91.94%.
  • Statistical Significance: Mann-Whitney U tests revealed statistically significant performance differences between the individual-level and both group-level and stability-level models, with very small p-values (e.g., 1.68e-14), indicating these performance gaps are not due to chance.
  • Stability Thresholds: The study identified stability thresholds for stable decision-making patterns: 0.63 or higher for DT1 and 0.66 for DT2.

Limitations and Future Work

  • Individual Model Scalability: A limitation of the individual-level model is that it requires training a separate model for each participant, which can be computationally expensive and challenging to scale for a very large number of users.
  • Mixed Results for Stability: While the stability model shows promise, the paper notes that the individual-level model generally outperforms it. The authors suggest that the variability in participants' preferences might contribute to this.
  • Future Research Directions: The authors advocate for future research to explore how AI systems can better align with stable participant preferences in diverse domains beyond kidney allocation. They also suggest further investigation into the dynamic nature of human preferences and how to effectively model them.

Summary updated

Abstract

In response to the pressing challenge of kidney allocation, characterized by growing demands for organs, this research sets out to develop a data-driven solution to this problem, which also incorporates stakeholder values. The primary objective of this study is to create a method for learning both individual and group-level preferences pertaining to kidney allocations. Drawing upon data from the 'Pairwise Kidney Patient Online Survey.' Leveraging two distinct datasets and evaluating across three levels - Individual, Group and Stability - we employ machine learning classifiers assessed through several metrics. The Individual level model predicts individual participant preferences, the Group level model aggregates preferences across participants, and the Stability level model, an extension of the Group level, evaluates the stability of these preferences over time. By incorporating stakeholder preferences into the kidney allocation process, we aspire to advance the ethical dimensions of organ transplantation, contributing to more transparent and equitable practices while promoting the integration of moral values into algorithmic decision-making.
BibTeX
@misc{sheraz2024towards,
  author = {Haleema Sheraz and Stefan C. Kremer and Joshua August Skorburg and Graham W. Taylor and Walter Sinnott‐Armstrong and Kyle Boerstler},
  title = {{Towards Stable Preferences for Stakeholder-aligned Machine Learning}},
  year = {2024},
  eprint = {2401.15268},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2401.15268},
}
Figure