Deep Learning-Based Glaucoma Detection Using Clinical Notes: A Comparative Study of Long Short-Term Memory and Convolutional Neural Network Models

Ali Mohammadjafari, Maohua Lin, Min ShiDiagnostics 2025 · DOI

TL;DR

This paper explores the use of deep learning models (LSTM and CNNs) to detect glaucoma from unstructured clinical notes, demonstrating that these models can achieve competitive performance without relying on imaging data. The study highlights that CNNs offer a more equitable performance across different racial groups compared to LSTMs, suggesting their potential for fairer AI-driven healthcare.

What Problem Does This Paper Address?

Glaucoma, a leading cause of irreversible blindness, is often detected late due to its gradual progression and subtle early symptoms. While retinal imaging is a common diagnostic tool, it requires specialized equipment, limiting its accessibility. This paper addresses the underutilization of rich, unstructured clinical notes generated by ophthalmologists, which contain valuable patient history, symptoms, and diagnostic impressions. The challenge lies in effectively extracting these subtle diagnostic signals from free-text notes to enable earlier glaucoma detection, especially in resource-limited settings. Furthermore, existing AI models may exhibit performance disparities across different demographic groups, raising concerns about fairness and equitable healthcare.

Methods

The researchers compared three main deep learning architectures for glaucoma detection from clinical notes:

  • Long Short-Term Memory (LSTM) networks: These models are adept at capturing temporal dependencies within sequential data, making them suitable for analyzing the narrative flow of clinical notes. They use gating mechanisms to maintain long-term dependencies.
  • Convolutional Neural Networks (CNNs): Typically used for image analysis, CNNs are adapted here to extract local patterns and hierarchical structures within text. They use convolutional filters to identify key phrases and n-grams relevant to glaucoma.
  • Transformer-based models (BERT and BioBERT): While not the primary focus of the comparative analysis, these models were mentioned as benchmarks, known for their ability to capture rich contextual information through self-attention mechanisms.

The study also incorporated Grad-CAM for model interpretability, visualizing which words in the clinical notes were most influential in the models' predictions. Additionally, they investigated adversarial debiasing techniques to mitigate demographic biases in model performance.

Datasets

The study utilized the FairCLIP dataset, a publicly available vision-language medical dataset. For this research, only the clinical notes component of the FairCLIP dataset was used, comprising 10,000 clinical notes from glaucoma patients. These notes were paired with demographic attributes (age, gender, ethnicity, language, marital status) and a binary label indicating the presence or absence of glaucoma. The dataset was relatively balanced in terms of glaucoma-positive and negative cases, but showed a significant imbalance in racial representation (76.9% White, 14.9% Black, 8.19% Asian).

Key Insights and Ideas

  • Clinical notes are a valuable source for glaucoma detection: The study demonstrates that deep learning models can effectively extract diagnostic signals from unstructured clinical text, achieving performance comparable to or exceeding some prior text-based and even multimodal approaches.
  • CNNs offer a more equitable performance: While CNNs and LSTMs performed similarly overall, CNNs showed reduced performance disparities across different racial groups (Asian, Black, White) compared to LSTMs. This suggests that CNNs might be better at learning features that are less susceptible to demographic biases present in the data.
  • Model interpretability is crucial: The use of Grad-CAM revealed that models prioritize medically relevant terms like "damage," "pressure," and "optic," aligning with clinical understanding and increasing trust in the AI's predictions.
  • Fairness is an ongoing challenge: Despite efforts, performance variations across demographic groups persist, highlighting the need for continued research into fairness-aware AI in healthcare.

Key Results

  • Overall Performance: The CNN model achieved an overall AUC of 0.80, slightly outperforming the LSTM model (AUC of 0.79).
  • Racial Group Performance:
    • LSTM: AUCs were 0.78 (White), 0.87 (Asian), and 0.81 (Black).
  • CNN: AUCs were 0.79 (White), 0.86 (Asian), and 0.83 (Black).
  • The CNN showed a smaller gap in AUC scores between racial groups compared to LSTM.
  • Confusion Matrix (CNN): Identified 633 true negatives and 832 true positives, with 344 false positives and 191 false negatives. This indicates improved sensitivity (fewer false negatives) compared to LSTM.
  • Computational Efficiency: The CNN model was significantly more computationally efficient than the LSTM model, with a much faster single-inference time (0.1846s vs. 0.5887s), making it more suitable for real-time applications.

Limitations and Future Work

  • Data Imbalance: The dataset had a significant imbalance in racial representation, which likely contributed to performance disparities.
  • Fairness Gaps: While CNNs showed improvement, performance differences across demographic groups still exist, indicating the need for further fairness-aware techniques.
  • Future Work:
    • Integrate attention-based mechanisms or transformers (like ClinicalBERT) for improved token-level explainability.
  • Explore API-based integration into existing Clinical Decision Support Systems (CDSSs) and Electronic Health Records (EHRs).
  • Develop more robust fairness-aware learning techniques, such as demographic parity regularization or demographically stratified training.
  • Investigate hybrid architectures combining LSTM and CNN to leverage the strengths of both models.
  • Further optimize models through quantization and pruning for enhanced real-time deployment.

Summary updated

Abstract

<b>Background/Objectives:</b> Glaucoma is the second-leading cause of irreversible blindness globally. Retinal images such as color fundus photography have been widely used to detect glaucoma. However, little is known about the effectiveness of using raw clinical notes generated by glaucoma specialists in detecting glaucoma. This study aims to investigate the capability of deep learning approaches to detect glaucoma from clinical notes based on a real-world dataset including 10,000 patients. Different popular models are explored to predict the binary glaucomatous status defined from a comprehensive vision function assessment. <b>Methods:</b> We compared multiple deep learning architectures, including Long Short-Term Memory (LSTM) networks, Convolutional Neural Networks (CNNs), and transformer-based models BERT and BioBERT. LSTM exploits temporal feature dependencies within the clinical notes, while CNNs focus on extracting local textual features, and transformer-based models leverage self-attention to capture rich contextual information and feature correlations. We also investigated the group disparities of deep learning for glaucoma detection in various demographic groups. <b>Results:</b> The experimental results indicate that the CNN model achieved an Overall AUC of 0.80, slightly outperforming LSTM by 0.01. Both models showed disparities and biases in performance across different racial groups. However, the CNN showed reduced group disparities compared to LSTM across Asian, Black, and White groups, meaning it has the advantage of achieving more equitable outcomes. <b>Conclusions:</b> This study demonstrates the potential of deep learning models to detect glaucoma from clinical notes and highlights the need for fairness-aware modeling to address health disparities.
BibTeX
@inproceedings{mohammadjafari2025deep,
  author = {Ali Mohammadjafari and Maohua Lin and Min Shi},
  title = {{Deep Learning-Based Glaucoma Detection Using Clinical Notes: A Comparative Study of Long Short-Term Memory and Convolutional Neural Network Models}},
  booktitle = {Diagnostics},
  year = {2025},
  doi = {10.3390/diagnostics15070807},
}
Figure