Learning Explainable Treatment Policies with Clinician-Informed Representations: A Practical Approach

Johannes O. Ferstad, Emily B. Fox, David Scheinker, Ramesh Johari

Introduction

Machine learning models in healthcare often face a dual challenge: small datasets and "black-box" complexity that hinders clinical trust. This research demonstrates that by leveraging clinician-informed representations—features designed based on medical expertise rather than raw data—it is possible to build treatment policies that are both more explainable and significantly more effective than state-of-the-art black-box algorithms.

In the context of Type 1 Diabetes (T1D), clinical teams must decide which patients to prioritize for intervention based on high-dimensional data from Continuous Glucose Monitors (CGMs). Purely algorithmic models often require massive datasets unavailable in clinical trials and lack the transparency needed for clinical adoption.

Methodology: An End-to-End Pipeline

The researchers developed a four-step pipeline for learning and evaluating targeting policies, focusing on the power of expert-driven inductive biases.

The end-to-end pipeline for learning and evaluating treatment policies, comparing clinician-informed and black-box representations.
  1. Representation Learning: The study compared two approaches for simplifying high-dimensional CGM traces and message text.
  2. Black-box Baselines: Unsupervised methods like TS2Vec and UMAP for sensor data, and clustered PaLM embeddings for text.
  3. Clinician-Informed: Features like "Time-in-Range" (TIR) and mean glucose. For actions, Gemini Pro (an LLM) extracted clinical labels from raw messages (e.g., identifying if a message recommended a dose change).
  4. CATE Estimation: Meta-learners (S-Learner, T-Learner, X-Learner, and Causal Forests) estimated the Conditional Average Treatment Effect (CATE) to predict individual patient benefit from specific interventions.
  5. Policy Induction: Patients were ranked by predicted benefit, selecting the top $K$ (clinic capacity) for intervention.
  6. Doubly Robust Evaluation: To account for clinician bias (messaging sicker patients more often), doubly robust scoring was used for fair evaluation.

Data and Experimental Setup

The study utilized data from three clinical trials involving remote monitoring of 281 patients with T1D. The dataset included granular CGM sensor data (readings every 5 minutes), demographics, and the raw text of thousands of clinician-sent treatment messages.

Key Results and Performance

The primary finding was the clear superiority of clinician-informed features over black-box representations.

Comparison of policy performance (ATT@25%) across different state and action representations. Clinician-informed features consistently outperform black-box baselines.
  • Efficacy: The best-performing policy (clinician-informed features with a T-Learner) achieved an ATT@25% of 6.6%. This indicates that intervening on the top 25% of patients identified by the model resulted in a 6.6% absolute increase in "Time-in-Range" compared to no intervention.
  • Baseline Comparison: Policies derived from black-box representations (TS2Vec/UMAP) performed similarly to random targeting, highlighting the limitations of unsupervised learning in small-sample, high-stakes medical contexts.
  • Alignment and Safety: Clinician-informed models naturally aligned with medical best practices, such as prioritizing patients with high mean glucose, whereas black-box models often made nonsensical recommendations.

Insights and Future Directions

The research highlights that in low-data regimes, expert-defined features act as a powerful "shortcut," filtering out noise and focusing on medically relevant variables. Furthermore, using LLMs as feature extractors—translating unstructured notes into categorical features—provides a scalable way to incorporate clinical nuance into interpretable models.

While the study focused on a one-week horizon, future work should investigate long-term outcomes like HbA1c levels. Additionally, applying this pipeline to other wearable data (e.g., heart rate or activity trackers) could determine if the "clinician-informed" advantage generalizes across other medical domains.

Summary updated

BibTeX
@inproceedings{ferstad2024learning,
  author = {Johannes O. Ferstad and Emily B. Fox and David Scheinker and Ramesh Johari},
  title = {{Learning Explainable Treatment Policies with Clinician-Informed Representations: A Practical Approach}},
  booktitle = {ML4H @ NeurIPS},
  year = {2024},
}
Figure