Multi-task Heterogeneous Graph Learning on Electronic Health Records

Tsai Hor Chan, Guosheng Yin, Kyongtae Bae, Lequan Yu

Electronic Health Records (EHRs) are a goldmine for medical AI, but they are notoriously "messy." They are sparse, highly heterogeneous—mixing medications, diagnoses, and lab results—and riddled with noise. Most existing models treat EHRs as simple sequences or homogeneous graphs, often focusing on a single task like mortality prediction. However, this approach ignores the complex, multi-dimensional relationships that define a patient's journey.

In the paper "Multi-task Heterogeneous Graph Learning on Electronic Health Records," researchers introduce MulT-EHR, a framework designed to navigate this complexity by treating the hospital database as a living, breathing knowledge graph.

The Challenges of EHR Analysis

The authors identify three primary hurdles that limit the effectiveness of standard deep learning models in healthcare:

  1. Relational Complexity: Standard models often miss the "meta-relations" (e.g., a patient linked to a treatment via a specific visit).
  2. Data Noisiness and Confounding: EHR data contains "backdoor paths"—shortcuts where a model might predict an outcome based on a hospital's administrative protocol rather than the patient's actual health status.
  3. Task Isolation: Most models are trained for one specific goal. In reality, clinical outcomes like length of stay and readmission risk are deeply interrelated.
EHR components and the core challenges of structural sparsity, noisiness, and heterogeneity.

The MulT-EHR Framework

To address these issues, MulT-EHR introduces three key innovations:

1. Heterogeneous Graph Construction

Instead of a flat list, the model builds a graph with six node types (Patients, Visits, Diagnoses, Prescriptions, Procedures, and Lab Events) and five distinct connection types. This allows the model to capture the intricate web of medical interactions.

Examples of complex meta-relations within the heterogeneous EHR graph.

2. Causal Denoising Module

Drawing from causal inference, the authors disentangle "causal" features from "trivial" noise. They use a uniform loss (based on Jensen-Shannon divergence) to ensure that trivial features don't provide a predictive "shortcut," forcing the model to rely on robust, invariant medical features.

3. Multi-task Learning

The model uses a single shared-weight Heterogeneous Graph Transformer to predict four tasks simultaneously: drug recommendation, length of stay, mortality, and readmission. To prevent overfitting to one task, a loss function minimizes the variance between task losses, encouraging the learning of task-invariant representations.

Empirical Evaluation

The researchers evaluated MulT-EHR on the MIMIC-III and MIMIC-IV datasets, which are the gold standard benchmarks in the field.

Key Results

MulT-EHR consistently outperformed state-of-the-art (SOTA) models across all four clinical tasks:

  • Mortality Prediction: Achieved an AUROC of 71.28% on MIMIC-III, surpassing previous leaders.
  • Drug Recommendation: Reached a Jaccard index of 52.20% on MIMIC-III, a substantial jump over specialized models like Safedrug.
  • Robustness: Ablation studies validated that both the causal denoising and multi-task modules are essential; removing either led to a significant performance drop.

Conclusion and Future Work

MulT-EHR demonstrates that the structural connections between medical entities are often more informative than mere chronological order. By explicitly preventing the model from using non-causal correlations and leveraging multi-task synergy, the framework achieves superior generalizability. Future work may involve integrating unstructured data like clinical notes or radiology scans and refining the causal interpretation of the model's attention weights to provide more rigorous clinical explanations.

Summary updated

Abstract

Learning electronic health records (EHRs) has received emerging attention because of its capability to facilitate accurate medical diagnosis. Since the EHRs contain enriched information specifying complex interactions between entities, modeling EHRs with graphs is shown to be effective in practice. The EHRs, however, present a great degree of heterogeneity, sparsity, and complexity, which hamper the performance of most of the models applied to them. Moreover, existing approaches modeling EHRs often focus on learning the representations for a single task, overlooking the multi-task nature of EHR analysis problems and resulting in limited generalizability across different tasks. In view of these limitations, we propose a novel framework for EHR modeling, namely MulT-EHR (Multi-Task EHR), which leverages a heterogeneous graph to mine the complex relations and model the heterogeneity in the EHRs. To mitigate the large degree of noise, we introduce a denoising module based on the causal inference framework to adjust for severe confounding effects and reduce noise in the EHR data. Additionally, since our model adopts a single graph neural network for simultaneous multi-task prediction, we design a multi-task learning module to leverage the inter-task knowledge to regularize the training process. Extensive empirical studies on MIMIC-III and MIMIC-IV datasets validate that the proposed method consistently outperforms the state-of-the-art designs in four popular EHR analysis tasks -- drug recommendation, and predictions of the length of stay, mortality, and readmission. Thorough ablation studies demonstrate the robustness of our method upon variations to key components and hyperparameters.
BibTeX
@article{chan2024multi,
  author = {Tsai Hor Chan and Guosheng Yin and Kyongtae Bae and Lequan Yu},
  title = {{Multi-task Heterogeneous Graph Learning on Electronic Health Records}},
  journal = {Neural Networks},
  year = {2024},
  doi = {10.1016/j.neunet.2024.106644},
}
Figure