Leveraging Informative Missingness as a Predictive Signal

583 concepts284 papers3 proposals

In traditional machine learning, missing data is treated as a nuisance—a "hole" in the dataset that must be patched through imputation or deletion before an algorithm can function. However, in many high-stakes domains, the fact that a data point is missing is not a random accident. Instead, it is a deliberate reflection of an underlying process. This concept, known as informative missingness, suggests that the pattern of data absence is itself a powerful predictive signal.

The Signal in the Void

The intuition behind informative missingness is most visible in clinical settings. As Phuoc Nguyen et al. note in Deep Learning to Attend to Risk in ICU, the decision to omit a medical test often indicates a clinician's perception of a patient's stability. If a doctor does not order a daily blood lactate test, it is likely because the patient is not showing signs of sepsis. Conversely, a sudden flurry of diagnostic tests reflects growing clinical suspicion.

When we treat these gaps as "Missing Completely at Random" (MCAR), we discard the expert intuition of the practitioners who collected the data. Joseph Futoma et al. argue in An Improved Multi-Output Gaussian Process RNN with Real-Time Validation for Early Sepsis Detection that the timing and frequency of observations act as a proxy for this expert intuition, capturing signals that physiological values alone might miss.

The Failure of Standard Imputation

Standard preprocessing workflows often rely on imputation—filling in missing values with the mean, median, or a zero. While this allows models to run, it often introduces significant bias. Horng-Ruey Chua and Kaiping Zheng point out in Health Care Analytics With Time-Invariant and Time-Variant Feature Importance to Predict Hospital-Acquired Acute Kidney Injury: Observational Longitudinal Study that zero-imputation fails to account for the reasons behind missingness, leading to inaccuracies in longitudinal modeling.

More importantly, imputation can destroy the very signal we want to capture. Raymond Feng et al. demonstrate in Adapting Fairness Interventions to Missing Values that "impute-then-classify" workflows can actually exacerbate algorithmic bias. By filling in gaps, models lose the ability to distinguish between a recorded "normal" value and a value that was never recorded because of systemic factors or participant behavior.

Encoding Absence as a Feature

To leverage informative missingness, researchers have moved toward treating the "missingness mask"—a binary indicator of whether a value exists—as a primary input feature. Xenia Miscouridou et al. show in Deep Survival Analysis: Nonparametrics and Missingness that using missingness indicators as primary features can achieve state-of-the-art performance without the complexity of synthetic value generation.

The theoretical justification for this approach was formalized by Mike Van Ness et al. in The Missing Indicator Method: From Low to High Dimensions. The authors provide a rigorous proof that the Missing Indicator Method (MIM) captures critical informative signals without degrading performance when missingness happens to be random. In high-dimensional settings, they propose Selective MIM (SMIM) to add indicators only where they provide a statistically significant predictive boost, preventing overfitting.

Beyond Clinical Data

While healthcare is the primary driver of this research, the principle applies to any domain where data collection is non-random:

Robustness and Clinical Presence

One of the most significant advantages of modeling informative missingness is robustness to "clinical presence shift." Vincent Jeanselme et al. introduce DeepJoint in Deep Survival Modelling Under Clinical Presence Shift, a model that explicitly learns the timing between observations. By understanding why and when tests are ordered, the model remains accurate even when hospital staffing schedules change (e.g., moving from weekday to weekend shifts), a scenario where standard models often fail because they rely on the frequency of data as a proxy for patient severity.

By shifting the perspective from "missing data as a problem" to "missingness as a signal," researchers are building models that better reflect the human decision-making and systemic behaviors inherent in real-world data collection.

History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 300 papers
  2. Version 1 · 2026-10-04 · 294 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_informative_missingness_adf70a8d,
  title = {informative missingness},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/informative-missingness/rdr_adf70a8d32b34a0d81fc921f6067cdeb},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 2, frozen text):

@misc{lacuna_informative_missingness_adf70a8d_v2,
  title = {informative missingness},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/informative-missingness/rdr_adf70a8d32b34a0d81fc921f6067cdeb/v/2},
  note = {Version 2, frozen 2026-10-04. Accessed 2026-11-21},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake