Patient-Specific Effects of Medication Using Latent Force Models with Gaussian Processes

Li-Fang Cheng, Bianca Dumitrascu, Michael Minyi Zhang, Corey Chivers, Michael Draugelis, Kai Li, Barbara E. Engelhardt

Introduction

In modern clinical settings, Electronic Health Records (EHR) provide a wealth of longitudinal data, including heart rate, blood pressure, and lab results. However, leveraging this data for predictive modeling is complicated by medical interventions. Drugs act as "shocks" to a patient's physiological system, creating temporary effects that vary significantly between individuals due to factors like genetics, age, and weight.

Standard machine learning models often struggle with these non-stationary events. Specifically, Gaussian Processes (GPs), while flexible, are typically symmetric in time and may "hallucinate" that a drug's effect began before it was actually administered. This paper introduces a framework that combines the flexibility of GPs with the structural "common sense" of physical laws to model patient-specific drug responses while strictly respecting causality.

Methodology

The researchers propose Causal Convolutional Gaussian Processes, a model that decomposes a patient's physiological state into two distinct components:

  1. Baseline Physiology: Modeled using a standard GP with a combination of Squared Exponential and Periodic kernels to capture smooth trends and natural circadian rhythms.
  2. Treatment Effect: Modeled via a Latent Force Model (LFM). Here, the patient's body is treated as a physical system governed by a first-order differential equation, with the drug acting as an external "force."

To ensure clinical validity, the authors developed specialized causal kernels that warp time, ensuring the latent force of a drug remains zero until the moment of administration. By mathematically convolving the physiology and treatment models, they derived analytical, closed-form solutions. This approach allows the model to be solved directly and efficiently, making it scalable for large hospital datasets.

Experimental Evaluation

The model was evaluated using EHR data from the Hospital of the University of Pennsylvania (HUP), focusing on a cohort of 1,716 adult patients diagnosed with Myocardial Infarction. Two primary studies were conducted:

  • Antihypertensive Study: Tracking Heart Rate (HR) and Systolic Blood Pressure (SBP) in 181 patients receiving Metoprolol.
  • Anticoagulant Study: Tracking Partial Thromboplastin Time (PTT) and International Normalized Ratio (INR) in 404 patients receiving Heparin or Warfarin.

Results and Discussion

The proposed model demonstrated significant improvements in both predictive accuracy and clinical consistency. On the anticoagulant task, the model achieved a Mean Absolute Error (MAE) of 12.248 for PTT and 0.180 for INR, outperforming several state-of-the-art baselines, including Linear Time-Invariant (LTI) filters.

Table 1: Performance comparison (Mean Absolute Error) across different kernels. The proposed causal convolutional GP achieves superior accuracy in the anticoagulant tasks (PTT and INR).

Beyond numerical accuracy, the model produced more realistic physiological response curves. Unlike baseline models that might predict a response prior to a dose, the causal kernel ensures that effects strictly follow causes. As shown in the visualization of patient-specific responses, the model correctly identifies the sharp physiological shifts only after the intervention occurs, while maintaining lower uncertainty (variance) compared to standard LTI models.

Figure 1: Patient-specific response curves for SBP and HR following Metoprolol administration. The model correctly identifies physiological changes only after the intervention (vertical lines), with subfigure (e) illustrating the underlying latent force.

Conclusion

By baking the concepts of absorption and decay into the model architecture, the authors have created a physics-informed machine learning framework that respects biological reality. While current limitations include the assumption of constant drug decay rates and the lack of multi-drug interaction modeling, this work represents a significant step toward personalized medicine. Future research will focus on kernel approximations to improve scalability and extending the model to account for fluctuating organ function and complex drug synergies.

Summary updated

Abstract

Multi-output Gaussian processes (GPs) are a flexible Bayesian nonparametric framework that has proven useful in jointly modeling the physiological states of patients in medical time series data. However, capturing the short-term effects of drugs and therapeutic interventions on patient physiological state remains challenging. We propose a novel approach that models the effect of interventions as a hybrid Gaussian process composed of a GP capturing patient physiology convolved with a latent force model capturing effects of treatments on specific physiological features. This convolution of a multi-output GP with a GP including a causal time-marked kernel leads to a well-characterized model of the patients' physiological state responding to interventions. We show that our model leads to analytically tractable cross-covariance functions, allowing scalable inference. Our hierarchical model includes estimates of patient-specific effects but allows sharing of support across patients. Our approach achieves competitive predictive performance on challenging hospital data, where we recover patient-specific response to the administration of three common drugs: one antihypertensive drug and two anticoagulants.
BibTeX
@inproceedings{cheng2020patient,
  author = {Li-Fang Cheng and Bianca Dumitrascu and Michael Minyi Zhang and Corey Chivers and Michael Draugelis and Kai Li and Barbara E. Engelhardt},
  title = {{Patient-Specific Effects of Medication Using Latent Force Models with Gaussian Processes}},
  booktitle = {International Conference on Artificial Intelligence and Statistics},
  year = {2020},
  url = {https://openreview.net/forum?id=bNa87-6gjOe},
}
Figure