Chain-of-Influence: Tracing Interdependencies Across Time and Features in Clinical Predictive Modeling

Yubo Li, Rema PadmanSubmission to ICLR 2026 · Desk rejected

TL;DR

Current clinical prediction models often act as black boxes or treat clinical variables independently over time, masking how one health event triggers another. Chain-of-Influence (CoI) is a deep learning architecture that pairs dual temporal and feature attention with Transformer self-attention to generate an explicit, time-unfolded graph of clinical dependencies. It achieves state-of-the-art predictive performance while providing an interpretable, step-by-step audit trail showing how past physiological changes cascade to drive future outcomes.

What Problem Does This Paper Address?

In clinical settings—from multi-year chronic illnesses to hour-by-hour intensive care—a patient's trajectory is driven by cascading chains of events. A drop in kidney function can lead to altered medications, metabolic abnormalities, and increased hospitalizations. Similarly, an acute blood pressure drop in the ICU triggers vasopressor administration, affecting cardiac output and subsequent organ failure.

Existing clinical machine learning models struggle to capture or explain these dynamic interactions:

  • Recurrent and static baseline models aggregate time or fail to capture long-range dependencies.
  • Attention-based architectures like RETAIN score individual visits or features in isolation, missing directed relationships between different variables across time.
  • Transformer-based self-attention generates dense, all-to-all correlation matrices that clinicians cannot readily translate into sequential, directed pathophysiological narratives.

Methods

CoI combines three complementary attention mechanisms into a unified framework:

  1. Dual Recurrent Attention Modules: Input features are projected into embeddings with fixed sinusoidal positional encodings. Two parallel Bidirectional LSTMs (BiLSTMs) extract:
  2. Temporal Attention ($\alpha$): A step-level scalar weight identifying when key risk inflection points occur.
  3. Feature Attention ($\beta$): An embedding-level weight identifying which attributes matter at each moment, applied immediately to scale embeddings.
  4. Cross-Feature Transformer Layers: The feature-weighted embeddings enter stacked Transformer layers utilizing Dynamic Tanh (DyT) normalization (replacing standard LayerNorm to better handle non-stationary clinical distributions) to model cross-feature and temporal interactions.
  5. Temporal Pooling & Prediction: Transformer representations are gated by the temporal attention weights $\alpha$, globally pooled, and passed through an MLP classifier.
  6. The Chain-of-Influence Measure:
  7. A local contribution matrix $C[t, i]$ combines input values, embedding weights, and both temporal and feature attention weights.
  8. Transformer attention across layers and heads is averaged into a temporal connectivity matrix $A[t, t']$.
  9. The chained influence metric is calculated as: $$I(t, i; t', j) = C[t, i] \times A[t, t'] \times C[t', j] \quad (t < t')$$ This quantifies how feature $i$ at earlier time $t$ influences feature $j$ at later time $t'$. Visualizations are simplified via recursive top-$k$ sparsification or path-tracing anchored to a specific clinical event (e.g., onset of Stage 5 Chronic Kidney Disease).
   Raw Inputs (B, T, Din)
             │
   Embedding + Positional Encoding
             ├──────────────────────────┐
             ▼                          ▼
    Temporal BiLSTM (α)         Feature BiLSTM (β)
             │                          │
             │           ┌──────────────┘
             │           ▼ (element-wise modulation)
             │     Transformer Layers + DyT Norm
             │     (Self-Attention Matrix A[t, t'])
             │           │
             └────► ⊗ ◄──┘ (Temporal Gating)
                    │
           Global Pooling & MLP ──► Prediction ŷ

Datasets

The authors evaluated CoI across two distinct temporal regimes:

  1. Proprietary Chronic Kidney Disease (CKD) Cohort:
  2. Tempo: Chronic, long-horizon (regular 3-month revisit intervals over 24 months; 8 visits).
  3. Size & Features: 1,422 patients; 38 features (demographics, comorbidities, lab biomarkers, billing/utilization).
  4. Task: Predicting progression to End-Stage Renal Disease (ESRD) (6.0% positive prevalence).
  5. MIMIC-IV (v3.1):
  6. Tempo: Acute critical care (irregular measurements aggregated into 1-hour windows over the first 48 hours).
  7. Size & Features: 65,366 unique first-ICU-stay patients; 15 variables (vital signs, labs, demographics) plus missingness masks and observation time gaps.
  8. Task: In-hospital mortality prediction (10.8% positive prevalence).

Severe class imbalance was mitigated using Temporal SMOTE (TSMOTE), an interpolation method that preserves trajectory ordering.

Key Insights and Ideas

  • Acute vs. Chronic Attention Divergence: Ablation experiments revealed that clinical context dictates architectural reliance:
  • For chronic progression (CKD), feature attention was paramount ($\Delta\text{AUROC} = -0.065$ when removed, vs. $-0.050$ for temporal attention)—predictive power is driven by which biomarker crosses a threshold.
  • For acute critical care (MIMIC-IV), temporal attention was dominant ($\Delta\text{AUROC} = -0.090$ when removed, vs. $-0.055$ for feature attention)—outcomes depend heavily on when physiological instability spikes.
  • Clinically Faithful Temporal Focusing: Unlike RETAIN, which smoothed attention evenly across visits with a mild recency bias, CoI learned a sharp U-shaped temporal curve on CKD. It placed high importance on baseline visits and the accelerated pre-ESRD window ($t_6$–$t_7$), reflecting clinical reality where routine intermediate visits carry less prognostic signal.
  • Attribution Faithfulness: Deletion-based sensitivity tests masking high-, middle-, and low-attention features/visits confirmed that removing high-attention nodes produced logit changes 2–2.5$\times$ larger than middle-attention deletions and 4–5$\times$ larger than low-attention deletions.

Key Results

CoI achieved state-of-the-art results across both benchmarks:

Dataset Metric Bi-LSTM RETAIN StageNet BEHRT-style CoI (Ours)
CKD (ESRD) AUROC 0.910 0.930 0.940 0.955 0.960
F1-Score 0.616 0.671 0.685 0.715 0.721
MIMIC-IV (Mortality) AUROC 0.700 0.944 0.920 0.948 0.950
F1-Score 0.267 0.667 0.768 0.834 0.865

On MIMIC-IV, CoI solved a critical clinical trade-off present in RETAIN. While RETAIN attained perfect recall (1.000) at the expense of precision (0.500—generating high alarm fatigue), CoI maintained strong recall (0.880) while raising precision to 0.850, yielding a +30% improvement in F1-score.

Limitations and Future Work

  • Statistical vs. Causal Associations: The authors note that the extracted influence pathways represent learned statistical associations, not formal causal interventions.
  • Attention Aggregation: Averaging cross-attention matrices across all Transformer layers and heads compresses multi-head representations, potentially masking fine-grained component roles.
  • Computational Scalability: The influence tensor computation scales with $\mathcal{O}(T^2 \cdot F^2)$ where $T$ is the number of time steps and $F$ is the feature count, making dense computation expensive for exceptionally long sequences or hundreds of clinical variables.
  • Future Directions: Integrating causal discovery algorithms and exploring sparse attention/tensor approximations to lower computational complexity.

Summary updated

Abstract

Modeling clinical time-series data is hampered by the challenge of capturing latent, time-varying dependencies among features. State-of-the-art approaches often rely on black-box mechanisms or simple aggregation, failing to explicitly model how the influence of one clinical variable propagates through others over time. We propose $\textbf{Chain-of-Influence (CoI)}$, an interpretable deep learning framework that constructs an explicit, time-unfolded graph of feature interactions. CoI enables the tracing of influence pathways, providing a granular audit trail that shows how any feature at any time contributes to the final prediction, both directly and through its influence on other variables. We evaluate CoI on mortality and disease progression tasks using the MIMIC-IV dataset and a chronic kidney disease cohort. Our framework achieves state-of-the-art predictive performance (AUROC of 0.960 on CKD progression and 0.950 on ICU mortality), with deletion-based sensitivity analyses confirming that CoI's learned attributions faithfully reflect its decision process. Through case studies, we demonstrate that CoI uncovers clinically meaningful, patient-specific patterns of disease progression, offering enhanced transparency into the temporal and cross-feature dependencies that inform clinical decision-making.
BibTeX
@misc{li2025chain,
  author = {Yubo Li and Rema Padman},
  title = {{Chain-of-Influence: Tracing Interdependencies Across Time and Features in Clinical Predictive Modeling}},
  year = {2025},
  eprint = {2510.09895},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2510.09895},
}
Figure