Supervised Laplacian Eigenmaps with Applications in Clinical Diagnostics for Pediatric Cardiology

Thomas Perry, Hongyuan Zha, Patricio Frias, Dadan Zeng, Mark L. BraunsteinarXiv 2012 · arXiv

Abstract

This paper introduces Supervised Laplacian Eigenmaps (SLE), a method that integrates short, unstructured clinical text with traditional numerical data to improve medical diagnostics. By jointly optimizing a low-dimensional text embedding and a predictive classifier, the authors achieved significant performance gains in diagnosing pediatric cardiac disease compared to models that ignore text or use standard unsupervised embeddings.

Introduction

In clinical settings, Electronic Health Records (EHRs) are a gold mine of information, but they are split into two worlds: structured numerical data (vitals, lab results) and unstructured text (physician notes, chief complaints). Most machine learning diagnostic aids focus on the numerical "vector space" data and discard the text. When researchers do include text, they often use unsupervised dimensionality reduction to turn text into numbers before training a model. This approach suffers from two main issues: task-agnostic embeddings that don't highlight features relevant to specific diagnoses, and the inherent complexity of short clinical notes filled with acronyms and synonyms.

Methodology

The authors propose a two-part solution to bridge the gap between structured and unstructured clinical data.

1. Text-Based Similarity Measure

To handle the messiness of short clinical notes, the researchers developed a similarity measure based on textual transformations. Instead of just looking for exact word matches, the system uses a transformation graph to account for synonyms, acronyms (e.g., "CP" vs. "Chest Pain"), and misspellings. Crucially, it breaks notes into individual complaints and compares them pair-wise to generate a robust similarity matrix.

Preprocessing clinical notes into similarity entries for manifold learning

2. Supervised Laplacian Eigenmaps (SLE)

Standard Laplacian Eigenmaps find a low-dimensional representation of data that preserves local similarities. The authors' "Supervised" twist adds a joint optimization step. They define an objective function that combines Laplacian manifold preservation with the loss function of a base learner (Logistic Regression). Using alternating gradient descent, the algorithm simultaneously learns the best low-dimensional coordinates for the text and the weights for the diagnostic classifier. This ensures the text embedding is specifically "tuned" to help predict the clinical outcome.

Experimental Setup

The model was evaluated on a real-world dataset from a large single-center pediatric cardiology practice, consisting of 2,067 patient records. The data included 69 numerical features and a single text field (the patient’s chief complaint). The task was to predict if a patient has cardiac disease, categorized as major, minor, or none, based on labels determined by a panel of physicians.

Key Results

The SLE method outperformed all baselines, including models that ignored text entirely and those using standard unsupervised text techniques. SLE achieved an AUC of 0.782 and an MCC of 0.374, representing an 8.16% increase in AUC and a 20.6% increase in MCC compared to a model using only numerical data.

Comparison of MCC performance across different KNN methods and unsupervised LE

As shown in the performance analysis, the supervised approach consistently provides a boost over unsupervised Laplacian Eigenmaps. Furthermore, the use of a Weighted K-Nearest Neighbor (KNN) approach allowed the model to effectively estimate embeddings for new, unseen patient data based on similarity to the training set.

Conclusion

The primary insight of this work is that embedding and classification should not be separate steps. By forcing the embedding to account for diagnostic labels, the model ignores "noisy" text variations while emphasizing subtle cues critical for diagnosis. While the model is sensitive to hyperparameters and requires domain-specific knowledge to build the initial similarity matrix, it offers a powerful framework for multi-modal clinical data. Future research may extend this framework to other unstructured data types, such as medical waveforms or imaging.

Summary updated

BibTeX
@misc{perry2012supervised,
  author = {Thomas Perry and Hongyuan Zha and Patricio Frias and Dadan Zeng and Mark L. Braunstein},
  title = {{Supervised Laplacian Eigenmaps with Applications in Clinical Diagnostics for Pediatric Cardiology}},
  year = {2012},
  eprint = {1207.7035},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1207.7035},
}
Figure