A hybrid neural network model for predicting kidney disease in hypertension patients based on electronic health records

Yafeng Ren, Hao Fei, Xiaohui Liang, Donghong Ji, Ming ChengBMC Medical Informatics Decis. Mak 2019 · OpenReview

TL;DR

This paper introduces a novel hybrid neural network model that combines BiLSTM and Autoencoders to predict kidney disease in hypertension patients using electronic health records (EHRs). By effectively integrating both textual descriptions and numerical indicators from EHRs, the model achieves a significant accuracy of 89.7%, outperforming traditional methods and demonstrating the power of deep learning for complex disease prediction.

What Problem Does This Paper Address?

Predicting the onset of diseases, especially chronic ones, is a critical area in healthcare. Electronic Health Records (EHRs) are a rich source of information for this purpose, containing both structured numerical data (like vital signs) and unstructured textual data (like doctor's notes and diagnoses). However, existing research often focuses on predicting a single disease and tends to rely heavily on statistical models that primarily use numerical EHR data, neglecting the valuable insights hidden within the textual descriptions. This gap limits the accuracy and comprehensiveness of disease prediction, particularly for conditions that often co-occur, like hypertension and kidney disease.

Methods

The authors propose a hybrid neural network architecture designed to leverage both textual and numerical information from EHRs. The core of their approach involves:

  • Bidirectional Long Short-Term Memory (BiLSTM): This recurrent neural network component is used to process the textual descriptions within EHRs. BiLSTM is adept at capturing sequential dependencies and contextual information from text, allowing it to understand the nuances of disease symptoms and patient histories described in natural language.
  • Autoencoder: This component is employed to process the numerical physical indicators (e.g., heart rate, blood pressure). Autoencoders are used here to reduce the dimensionality of the numerical data and learn a compressed, meaningful representation, effectively handling potential correlations and noise.
  • Hybrid Integration: The representations learned by the BiLSTM (from text) and the Autoencoder (from numerical data) are then combined. This combined representation is fed into a fully connected layer, which acts as a classifier to predict the probability of kidney disease. Dropout is used to prevent overfitting.

The problem is framed as a binary classification task: predicting whether a hypertension patient will develop kidney disease.

Datasets

The researchers constructed a new dataset from raw EHR data collected from 12 cities in China over a 5-year period (2012-2017). After preprocessing to remove personal privacy information and merge records for the same patient, the dataset consists of:

  • Positive Examples: Records where patients have both hypertension and kidney disease.
  • Negative Examples: Records where patients have hypertension but not kidney disease.

The initial dataset contained 35,332 records, with a significant class imbalance (1100 positive vs. 34,232 negative). To address this, an under-sampling technique was applied, reducing the majority class to match the minority class size, resulting in a balanced dataset of 2200 records (1100 positive, 1100 negative). This under-sampling process was repeated ten times to ensure robustness, and the final accuracy was an average of these ten experiments.

Key Insights and Ideas

  • Textual Data is Crucial: The study strongly suggests that textual descriptions in EHRs carry significant, often underutilized, diagnostic cues that are vital for accurate disease prediction.
  • Hybrid Models Excel: Combining different types of data (textual and numerical) through a hybrid model architecture leads to superior performance compared to models that use only one type of feature.
  • Deep Learning for EHRs: Neural networks, particularly BiLSTM and Autoencoders, are highly effective at learning complex patterns and representations from both unstructured text and structured numerical data within EHRs, surpassing traditional statistical methods.
  • Co-occurring Diseases: The research highlights the importance of studying the prediction of multiple associated diseases, as conditions like hypertension and kidney disease are often linked.

Key Results

The proposed hybrid neural network model, combining BiLSTM and Autoencoder, achieved an impressive 89.7% accuracy on the task of predicting kidney disease in hypertension patients. This significantly outperformed:

  • Discrete Models: Including Logistic Regression (LR), Naive Bayes (NB), Support Vector Machine (SVM), and Gradient Boosting Decision Tree (GBDT). The best discrete model, GBDT, reached 81.2% accuracy.
  • Neural Baseline Models: Such as Convolutional Neural Network (CNN) and Bi-directional Long Short-Term Memory (BiLSTM) alone. The best neural baseline (BiLSTM with Textual+Numerical features) achieved 87.6% accuracy.
  • Hybrid Neural Baselines: A CNN integrated with an Autoencoder (CNN+AE) reached 88.3% accuracy.

The study also showed that models using both textual and numerical features generally performed better than those using only one type.

Limitations and Future Work

The authors acknowledge that the experimental data, due to privacy concerns, cannot be shared.

For future work, they propose two main directions:

  1. Attention Mechanisms: Exploring attention-based neural networks to assign different weights to various factors, which could help visualize and identify the most critical risk factors for kidney disease in hypertension patients.
  2. Coronary Heart Disease Prediction: Extending their research to predict coronary heart disease in hypertension patients and identify its associated risk factors.

Summary updated

Abstract

Background Disease prediction based on Electronic Health Records (EHR) has become one hot research topic in biomedical community. Existing work mainly focuses on the prediction of one target disease, and little work is proposed for multiple associated diseases prediction. Meanwhile, a piece of EHR usually contains two main information: the textual description and physical indicators. However, existing work largely adopts statistical models with discrete features from numerical physical indicators in EHR, and fails to make full use of textual description information. Methods In this paper, we study the problem of kidney disease prediction in hypertension patients by using neural network model. Specifically, we first model the prediction problem as a binary classification task. Then we propose a hybrid neural network which incorporates Bidirectional Long Short-Term Memory (BiLSTM) and Autoencoder networks to fully capture the information in EHR. Results We construct a dataset based on a large number of raw EHR data. The dataset consists of totally 35,332 records from hypertension patients. Experimental results show that the proposed neural model achieves 89.7% accuracy for the task. Conclusions A hybrid neural network model was presented. Based on the constructed dataset, the comparison results of different models demonstrated the effectiveness of the proposed neural model. The proposed model outperformed traditional statistical models with discrete features and neural baseline systems.
BibTeX
@inproceedings{ren2019hybrid,
  author = {Yafeng Ren and Hao Fei and Xiaohui Liang and Donghong Ji and Ming Cheng},
  title = {{A hybrid neural network model for predicting kidney disease in hypertension patients based on electronic health records}},
  booktitle = {BMC Medical Informatics Decis. Mak},
  year = {2019},
  url = {https://openreview.net/forum?id=SlygUbBRzH1},
}
Figure