Dynamic Feature Importance in Clinical Time Series

21 concepts19 papers1 proposal

Imagine a patient admitted to the Intensive Care Unit. On day one, a sudden spike in liver enzymes might be the single most critical indicator of mortality risk. By day seven, however, the liver may have stabilized, and the primary threat might shift entirely to respiratory or cardiac function.

Traditional machine learning models often treat clinical features as having static predictive weights. They assume that a lab value, vital sign, or symptom carries the same diagnostic signal regardless of when it is measured or how long the patient has been hospitalized. In reality, the human body is a highly dynamic system, and the clinical relevance of any given biomarker fluctuates continuously over time.

To capture this reality, a prominent research direction focuses on dynamic feature importance—developing architectures and statistical frameworks that explicitly model how the predictive utility of variables shifts across different temporal windows, clinical contexts, and prediction horizons.

Why Static Models Fail: The Problem of Fixed Parameters

Standard sequence models, such as standard Recurrent Neural Networks (RNNs), process time-series data by applying the same transition parameters at every step. As Jeeheh Oh et al. point out in Relaxed Parameter Sharing: Effectively Modeling Time-Varying Relationships in Clinical Time-Series, this assumption of constant relationships fails to capture shifting physiological states over a patient's stay. For instance, a respiratory marker might become a significantly stronger indicator of risk the longer a patient remains on ventilation, a nuance that static parameter sharing completely dilutes.

When models cannot adjust their internal logic over time, they suffer from a disconnect between model outputs and actual clinical progression. This limitation is highly visible across different prediction windows:

Architectural Mechanisms for Dynamic Weighting

To allow a model's focus to shift dynamically, researchers have engineered several distinct architectural mechanisms that move beyond static feature evaluation.

Relaxed Parameters and Continuous Curves

Instead of forcing a model to use identical weights at every time step, the parameters themselves can be allowed to evolve. The mixLSTM architecture proposed by Jeeheh Oh et al. relaxes parameter sharing to let the model's internal logic adapt to different stages of a clinical timeline. Taking a functional approach, Yashu Liu et al. developed a framework in Sparse Generalized Functional Linear Model for Predicting Remission Status of Depression Patients that treats patient data as continuous curves rather than discrete points, using regularization to isolate specific temporal windows where symptoms are highly relevant before they lose significance.

Feature-Specific Decay and Contextual Recalibration

Not all biomarkers age at the same rate. An acute white blood cell count spike loses its predictive relevance quickly, whereas long-term blood pressure trends decay slowly. To capture this, Liantao Ma et al. introduced ConCare in ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Context, which models personalized, feature-specific decay parameters to weight historical data based on the unique nature of each measurement.

In a parallel work, AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibration, Liantao Ma et al. utilized multi-scale dilated convolutions combined with an adaptive recalibration mechanism. This allows the model to dynamically scale the importance of specific biomarkers based on the patient's real-time health status, ensuring that the most critical indicators are prioritized during acute health crises.

Pseudo-Dynamic and Time-Variant Modules

To maintain interpretability without sacrificing deep learning's flexibility, Munib Mesinovic et al. developed Explainable machine learning for predicting ICU mortality in myocardial infarction patients using pseudo-dynamic data. By transforming time-series data into "pseudo-dynamic" summary statistics, they capture how acute physiological measurements become significantly more influential as a patient nears a critical event. Similarly, Horng-Ruey Chua et al. introduced a Time-Invariant and Time-Variant (TITV) module in Health Care Analytics With Time-Invariant and Time-Variant Feature Importance to Predict Hospital-Acquired Acute Kidney Injury: Observational Longitudinal Study to explicitly decouple stable baseline risks from fluctuating biomarker trends across different segments of a hospital stay.

Static Modeling:  [Feature X] ---> (Fixed Weight W) ---> Prediction

                                  /---> Early Stage: High Weight W1 ---> Prediction
Dynamic Modeling: [Feature X] --->|
                                  \---> Late Stage:  Low Weight W2  ---> Prediction

Shifting Modalities and Horizons

Dynamic feature relevance does not just apply to individual lab values; it also governs how entirely different sources of data interact over time and how disease trajectories unfold.

The Recovery Timeline

The optimal features for prediction depend heavily on the stage of a patient's recovery or disease progression. For instance, Julien Hogan et al. found in Assessing Predictors of Early and Late Hospital Readmission After Kidney Transplantation that post-surgical readmissions are driven by acute clinical markers in the short term (0–30 days), but shift to broader indicators of recovery complexity (like initial length of stay) for long-term outcomes.

A similar pattern appears in chronic conditions and post-acute care:

The Modality Shift

During a hospital stay, the availability and relevance of documentation changes. Both Shih-Ting Cindy Huang et al. in Predictive Multimodal Modeling of Diagnoses and Treatments in EHR and Mireia Hernandez Caralt et al. in Continuous Predictive Modeling of Clinical Notes and ICD Codes in Patient Health Records demonstrated that predictive models naturally shift attention from structured, high-signal technical reports early in an admission to comprehensive narrative clinical summaries as the stay progresses.

Failing to account for these temporal shifts can severely degrade model performance. As Meng Xia et al. note in Contrastive Learning for Clinical Outcome Prediction with Partial Data Sources, standard contrastive learning techniques that treat all time points equally fail because they do not prioritize the physiological patterns closest or most relevant to the ultimate medical event.

By moving away from static feature weights and embracing time-variant relevance, these frameworks allow machine learning models to mirror the clinical intuition of human physicians—recognizing that the value of a piece of data is fundamentally tied to when it occurs in a patient's journey.

Key Foundational Work

Predicting with Variables Constructed from Temporal Sequences (2001) — contributed 1 concept elements to this direction.
Sparse Generalized Functional Linear Model for Predicting Remission Status of Depression Patients (2014) — contributed 1 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_dynamic_feature_importance_dynamic_featu_d04e34fb,
  title = {dynamic feature importance (dynamic feature relevance)},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/dynamic-feature-importance-dynamic-feature-relevance/rdr_d04e34fbcac64c4d9b1d47dc840da274},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 1, frozen text):

@misc{lacuna_dynamic_feature_importance_dynamic_featu_d04e34fb_v1,
  title = {dynamic feature importance (dynamic feature relevance)},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/dynamic-feature-importance-dynamic-feature-relevance/rdr_d04e34fbcac64c4d9b1d47dc840da274/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake