A transformer-based deep learning approach for fairly predicting post-liver transplant risk factors

Can Li, Xiaoqian Jiang, Kai Zhang

TL;DR

This paper introduces a Transformer-based deep learning model that simultaneously predicts multiple post-liver transplant risks while ensuring fairness across different demographic groups. By combining multi-task learning with novel task-balancing and fairness-achieving algorithms, the model significantly reduces prediction disparities, paving the way for more equitable organ allocation and patient care.

What Problem Does This Paper Address?

Liver transplantation is a critical procedure, but two major challenges persist: optimizing donor-recipient matching and ensuring transplant equity across diverse patient populations. Current risk assessment tools, like the MELD score, primarily focus on short-term mortality and don't fully account for crucial post-transplant risks (e.g., rejection, cardiovascular disease, infection). Predicting these multiple risks accurately is complex, and existing methods often struggle with imbalanced datasets and can exhibit biases against certain demographic groups (gender, age, race/ethnicity). This lack of fairness can lead to unequal access to transplants and suboptimal patient outcomes.

Methods

The core of this work is a Transformer-based multi-task learning model called TabTransformer. This architecture is adapted to handle tabular data by using self-attention mechanisms to capture complex feature interactions. The model is designed to:

  • Multi-task Learning: Simultaneously predict five key post-transplant risk factors.
  • Task Balancing: Employ a dynamic re-weighting strategy to ensure that tasks with lower performance receive more attention during training, leading to a more balanced overall performance across all risk predictions. This is achieved using an AUROC-weighted approach.
  • Fairness-Achieving Algorithm: Introduce a novel algorithm to ensure equitable prediction performance across different subgroups defined by sensitive attributes (gender, age, race/ethnicity). This algorithm quantifies disparity using measures like Demographic Parity Difference (DPD) and Equalized Odds Difference (EOD) and integrates them into the loss function.

The overall approach combines task balancing and fairness optimization in a unified framework.

Datasets

The study utilized a large-scale dataset of 160,360 liver transplant patients from the Organ Procurement and Transplantation Network (OPTN) in the United States, spanning from 1987 to 2018. This dataset includes demographic information, clinical variables, and laboratory values. The data was split into 60% for training, 20% for validation, and 20% for testing, with 5-fold cross-validation employed.

Key Insights and Ideas

  • Interdependence of Risks: Post-transplant risk factors are highly interdependent, making a multi-task learning approach more effective than predicting each risk in isolation.
  • Demographic Features Drive Bias: The model, even without explicit fairness constraints, relies heavily on demographic features (age, race/ethnicity, gender) for predictions, highlighting their potential to introduce bias if not managed.
  • Fairness Interventions Reduce Bias: Applying fairness-achieving algorithms effectively mitigates disparities in predictions across sensitive attributes, demonstrating the importance of integrating fairness into model development.
  • Task Balancing is Crucial for Multi-task Performance: Addressing task imbalance is essential for achieving robust and accurate predictions across multiple related tasks, especially when dealing with varying prevalence of risk factors.

Key Results

  • The proposed Multi-task AUROC-Weighted model significantly improved task balancing, reducing the AUROC disparity across the five tasks by 39% compared to a single-task approach.
  • The fairness-achieving algorithm substantially reduced fairness disparity across all sensitive attributes (gender, age group, race/ethnicity) for each risk factor. For example, the Demographic Parity Difference (DPD) for rejection risk was reduced from 0.1642 to 0.0039 with the DP model and 0.0107 with the EO model.
  • The model achieved high prediction accuracy, with the AUROC-Weighted model showing the best performance and task balancing.

Limitations and Future Work

  • Model Bias: The paper acknowledges that the model's bias is primarily focused on training and inference, and further improvements could be made by designing new training strategies and loss functions.
  • Trade-off Between Accuracy and Fairness: Like many fairness algorithms, there's an inherent trade-off between overall model accuracy and equitable performance across tasks and subgroups. Designing an optimized loss function to balance these objectives remains a challenge.
  • Temporal Dynamics: While MICE was used for missing data, the model may not fully capture temporal dynamics in medical practices and patient demographics over the long study period (1987-2018). Future research could explore these temporal aspects and demographic changes more deeply.

Summary updated

Abstract

Liver transplantation is a life-saving procedure for patients with end-stage liver disease. There are two main challenges in liver transplant: finding the best matching patient for a donor and ensuring transplant equity among different subpopulations. The current MELD scoring system evaluates a patient's mortality risk if not receiving an organ within 90 days. However, the donor-patient matching should also consider post-transplant risk factors, such as cardiovascular disease, chronic rejection, etc., which are all common complications after transplant. Accurate prediction of these risk scores remains a significant challenge. In this study, we used predictive models to solve the above challenges. Specifically, we proposed a deep learning model to predict multiple risk factors after a liver transplant. By formulating it as a multi-task learning problem, the proposed deep neural network was trained to simultaneously predict the five post-transplant risks and achieve equal good performance by exploiting task-balancing techniques. We also proposed a novel fairness-achieving algorithm to ensure prediction fairness across different subpopulations. We used electronic health records of 160,360 liver transplant patients, including demographic information, clinical variables, and laboratory values, collected from the liver transplant records of the United States from 1987 to 2018. The model's performance was evaluated using various performance metrics such as AUROC and AUPRC. Our experiment results highlighted the success of our multi-task model in achieving task balance while maintaining accuracy. The model significantly reduced the task discrepancy by 39 %. Further application of the fairness-achieving algorithm substantially reduced fairness disparity among all sensitive attributes (gender, age group, and race/ethnicity) in each risk factor. It underlined the potency of integrating fairness considerations into the task-balancing framework, ensuring robust and fair predictions across multiple tasks and diverse demographic groups.
BibTeX
@article{li2024transformer,
  author = {Can Li and Xiaoqian Jiang and Kai Zhang},
  title = {{A transformer-based deep learning approach for fairly predicting post-liver transplant risk factors}},
  journal = {J. Biomed. Informatics},
  year = {2024},
  url = {https://openreview.net/forum?id=oaZvpKK9hH},
}
Figure