TL;DR
This paper introduces PopKLD, an automated algorithm that summarizes complex electronic health record (EHR) laboratory data into a more informative and robust representation. This new summary better captures underlying physiological signals, even in the presence of healthcare process biases, and proves superior to traditional methods like mean and standard deviation for tasks like disease phenotyping.
What Problem Does This Paper Address?
Electronic health records (EHRs) contain a wealth of laboratory data, but this data is often noisy, irregularly sampled, and influenced by the "health care process" (e.g., when and why tests are ordered). Traditional methods for summarizing this data, like calculating the mean and standard deviation, often fail to capture important physiological information and can be misled by biases. This makes it challenging to use EHR laboratory data effectively for research, particularly for high-throughput phenotyping (identifying patient subgroups based on their characteristics). The authors aim to develop a method that can automatically extract a more meaningful, robust, and interpretable summary from this raw data, accounting for biases and preserving physiological signals.
Methods
The core of the paper is the PopKLD (Population Kullback-Leibler Divergence) algorithm. It works by:
- Selecting a set of parameterized probability distributions (e.g., Gaussian, log-normal, GEV) that could potentially model the laboratory data.
- Estimating the parameters for each of these distributions using the entire population's laboratory data.
- Estimating the true, non-parametric distribution of the population's laboratory data using a Kernel Density Estimate (KDE).
- Calculating the Kullback-Leibler (KL) divergence between each parameterized distribution and the non-parametric KDE. This measures how much information is lost when approximating the true distribution with a simpler parameterized one.
- Selecting the parameterized distribution that minimizes the KL divergence. This distribution is considered the "best fit" for the population's data.
- Estimating the parameters of this selected distribution for each individual patient. These individual parameter estimates serve as the summary statistics.
Additionally, they introduce PopKLD-CAT, which transforms these continuous summary parameters into categorical variables, making them suitable for methods like topic modeling.
Datasets
The study utilized two primary datasets:
- NewYork-Presbyterian Hospital (NYPH) clinical data warehouse: This dataset comprised longitudinal records for approximately 14,000 patients visiting the Ambulatory Internal Medicine clinic over 20 years, including 64 frequently ordered laboratory tests.
- Neurological Intensive Care Unit (ICU) data: This dataset included 814 patients who were comatose and tube-fed, focusing specifically on glucose measurements collected during their ICU stay. This dataset was used to isolate physiological signals with minimal healthcare process bias.
Key Insights and Ideas
- Healthcare process biases are significant: The way data is collected and influenced by clinical decisions (the "health care process") profoundly impacts laboratory data distributions, often obscuring underlying physiology.
- Traditional summaries are often insufficient: Mean and standard deviation are non-robust and can be easily misled by outliers and biases, failing to capture crucial information.
- Model selection is key: Using information-theoretic measures like KL divergence allows for a principled way to select the best parametric model to represent complex, noisy data.
- Different contexts demand different models: The optimal statistical model for summarizing a laboratory test can vary significantly depending on the clinical context (e.g., ICU vs. general outpatient).
- Physiological relationships are preserved: The PopKLD algorithm successfully identifies and preserves known physiological relationships (e.g., between mean and standard deviation of glucose) that are lost with simpler summary statistics.
- Maximum entropy as a guide: The principle of maximum entropy can predict which distributions are likely to be most informative for certain data types, serving as a useful benchmark for evaluating PopKLD's model choices.
Key Results
- Improved Phenotyping: In a phenotyping task for diabetes, CKD, and pancreatitis, PopKLD-derived summaries (both continuous and categorical) significantly outperformed traditional mean and standard deviation summaries in identifying disease states, achieving higher cluster purity against a gold standard. For example, in identifying diabetes using glucose, PopKLD achieved a purity of 0.93 (15/15 patients) with a GEV model, while mean/standard deviation achieved only 0.53 (8/15 patients).
- Preservation of Physiology: For glucose data, PopKLD identified models (log-normal and gamma) that revealed the known linear relationship between mean and standard deviation, a relationship obscured by raw mean/standard deviation calculations.
- Model Diversity: The study found no single "best" distribution for all laboratory tests; different tests and contexts necessitate different models, highlighting the value of PopKLD's model selection approach.
- Robustness to Outliers: PopKLD models, particularly GEV and log-normal, demonstrated a better ability to handle outliers compared to simple mean and standard deviation.
Limitations and Future Work
- Assumptions: The algorithm assumes that a single parameterized distribution can reasonably represent the population's data, even with variations. It also assumes that the chosen models are sufficient to capture the underlying generating process.
- Interpretability vs. Accuracy: While PopKLD strikes a balance, further modifications could increase accuracy (e.g., using more complex models like KDEs or neural networks) at the potential cost of interpretability.
- Uncertainty Quantification: The current PopKLD algorithm does not explicitly quantify uncertainty in its estimates. The authors suggest that incorporating methods like bootstrapping could address this.
- Model Averaging: For applications where multiple models perform similarly well, using model averaging or ensemble learning could further improve robustness.
- Health Care Process Understanding: While PopKLD accounts for biases, a deeper understanding of the specific health care processes generating the data could lead to even more refined summarization.
Summary updated