An innovative strategy for standardized, structured, and interoperable results in ophthalmic examinations

Yongseok Mun, Jooyoung Kim, Kyoung Jin Noh, Soochahn Lee, Seok Kim, Soyoung Yi, Kyu Hyung Park, Sooyoung Yoo, Dong-Jin Chang, Sang Jun Park

Abstract

Optical Coherence Tomography (OCT) is the gold standard for diagnosing retinal diseases, yet clinical data often remains trapped in static, proprietary image formats. This study introduces a deep learning-based pipeline to transform these non-standardized reports into structured, interoperable data. By integrating a custom OCR engine with a spatial "Area Explorer," the system achieves 99.67% accuracy across nearly half a million clinical reports. The resulting data is converted into the OMOP Common Data Model (CDM), facilitating large-scale longitudinal research and cross-institutional interoperability.

Introduction

In modern ophthalmology, the "data silo" problem significantly hinders clinical research and patient care. While OCT devices provide critical diagnostic information, they typically output reports as static PDFs or JPEGs. Because manufacturers use proprietary formats, interoperability between hospital systems is virtually non-existent. Clinicians must manually review historical PDFs to track disease progression, and researchers face immense manual data entry burdens. This paper proposes an automated Extract, Transform, and Load (ETL) strategy to unlock this trapped information.

Methodology: The Deep Learning Pipeline

The researchers developed a modular software suite to automate the extraction and standardization process. The architecture is designed to handle the spatial complexity of medical reports while ensuring high-precision data recovery.

System architecture illustrating the flow from raw OCT reports to standardized CDM databases.

The pipeline consists of three primary components:

  1. Area Explorer: This module utilizes configuration files to identify specific regions of interest (ROIs) on a report. It distinguishes between numeric values and tomographic images, providing the necessary spatial context.
  2. Value Reader (OCR): To overcome the limitations of standard OCR tools on specialized medical fonts, a custom engine was built. It employs a ResNet backbone for feature extraction and a Bidirectional LSTM for sequence modeling, specifically optimized for numeric measurements.
  3. Finding Classifier: This deep learning model analyzes the tomographic images within the report to identify pathological features, such as subretinal fluid or macular edema.

Data Extraction and Validation

The system was trained and validated using a combination of synthetic and real-world clinical data:

  • Synthetic Training: To avoid labeling fatigue, 1 million synthetic images were generated to simulate various font sizes, contrasts, and noise levels typical of medical scans.
  • Clinical Evaluation: A set of 300 OCT reports was manually labeled by experts to serve as a ground truth.
  • Large-Scale Deployment: The pipeline processed an archive of 433,175 OCT reports from Seoul National University Bundang Hospital, spanning the years 2006 to 2019.
Ophthalmic reports with red boxes indicating the specific areas selected for automated recognition.

Key Results and Insights

The Value Reader achieved a remarkable 99.67% accuracy in converting image-based numbers to structured text. This high precision allowed for the successful processing of over 13 years of historical data, creating a longitudinal dataset that enables clinicians to filter and sort patient progress effortlessly.

A critical insight from this work is the importance of structural context. By knowing exactly where a number is located (via the Area Explorer), the system understands its clinical meaning—for example, distinguishing between central macular thickness and retinal nerve fiber layer thickness. Furthermore, by targeting the OMOP Common Data Model (CDM), the authors enable ophthalmic data to be analyzed alongside broader clinical datasets, such as pharmacy and genomic records, in multi-center studies.

Conclusion and Future Directions

While the current system demonstrates high throughput and precision, it is primarily designed for retrospective batch processing. Future work aims to develop real-time integration with Electronic Health Records (EHR) and expand support to a wider variety of device manufacturers and exam types, such as corneal topography. Despite these challenges, this strategy represents a significant step toward breaking down data silos in ophthalmology and enabling truly interoperable medical research.

Summary updated

Abstract

Background Although ophthalmic devices have made remarkable progress and are widely used, most lack standardization of both image review and results reporting systems, making interoperability unachievable. We developed and validated new software for extracting, transforming, and storing information from report images produced by ophthalmic examination devices to generate standardized, structured, and interoperable information to assist ophthalmologists in eye clinics. Results We selected report images derived from optical coherence tomography (OCT). The new software consists of three parts: (1) The Area Explorer, which determines whether the designated area in the configuration file contains numeric values or tomographic images; (2) The Value Reader, which converts images to text according to ophthalmic measurements; and (3) The Finding Classifier, which classifies pathologic findings from tomographic images included in the report. After assessment of Value Reader accuracy by human experts, all report images were converted and stored in a database. We applied the Value Reader, which achieved 99.67% accuracy, to a total of 433,175 OCT report images acquired in a single tertiary hospital from 07/04/2006 to 08/31/2019. The Finding Classifier provided pathologic findings (e.g., macular edema and subretinal fluid) and disease activity. Patient longitudinal data could be easily reviewed to document changes in measurements over time. The final results were loaded into a common data model (CDM), and the cropped tomographic images were loaded into the Picture Archive Communication System. Conclusions The newly developed software extracts valuable information from OCT images and may be extended to other types of report image files produced by medical devices. Furthermore, powerful databases such as the CDM may be implemented or augmented by adding the information captured through our program.
BibTeX
@article{mun2021innovative,
  author = {Yongseok Mun and Jooyoung Kim and Kyoung Jin Noh and Soochahn Lee and Seok Kim and Soyoung Yi and Kyu Hyung Park and Sooyoung Yoo and Dong-Jin Chang and Sang Jun Park},
  title = {{An innovative strategy for standardized, structured, and interoperable results in ophthalmic examinations}},
  journal = {Bmc Medical Informatics Decis. mak},
  year = {2021},
  doi = {10.1186/s12911-020-01370-0},
}
Figure