Abstract
This study investigates the eye movement patterns of ophthalmologists with varying expertise levels during the assessment of optical coherence tomography (OCT) reports for glaucoma detection. By recording gaze metrics from 13 participants (residents, fellows, and faculty), the researchers derived novel features using Sequence Graph Transform (SGT) to develop binary classification models. The results demonstrate that expert ophthalmologists exhibit more refined and focused fixations on critical diagnostic regions. AI models trained on these gaze patterns achieved up to 94.0% accuracy in differentiating between expert and novice clinicians, suggesting that eye-tracking can effectively "fingerprint" clinical expertise.
Introduction
Glaucoma is a leading cause of irreversible blindness, and early detection often hinges on interpreting complex Optical Coherence Tomography (OCT) reports. However, interpreting these reports is notoriously subjective; there is no universal "gold standard" for what features a clinician should prioritize. This study asks a different question: Can we model the human expert? By understanding the "search strategy" of a seasoned specialist, we can improve medical education for residents and build more "human-like" diagnostic AI. The challenge lies in turning unstructured, "messy" eye movements into structured data that a machine can understand.
Methods
The researchers recruited 13 clinicians from the Columbia University Irving Medical Center, ranging from junior residents to faculty experts. Participants diagnosed 20 digital Topcon swept-source OCT reports (10 healthy, 10 glaucomatous) while their gaze was recorded using Pupil Labs Core eye trackers.
The technical pipeline involved:
- Region of Interest (ROI) Mapping: The OCT report was divided into seven functional zones (e.g., RNFL thickness maps, probability charts).
- Sequence Graph Transform (SGT): This is the study's novel feature-engineering step. Instead of just looking at where someone looked, SGT creates an embedding that captures the sequence and relationship between fixations, turning a temporal stream of gaze data into a high-dimensional feature vector.
- Supervised Learning: They trained simple feed-forward neural networks to classify the viewer as "Expert" or "Novice" and to classify the report as "Healthy" or "Glaucomatous" based only on the expert's gaze.
Key Insights and Results
- The Expertise Fingerprint: The model achieved 94.0% accuracy (AUC 0.94) in differentiating between expert and novice clinicians based on their eye movements. This suggests that "expertise" is a distinct, measurable physical behavior.
- Validation of Clinical Heuristics: The data showed that experts prioritize the RNFL probability map and the circumpapillary RNFL b-scan. This statistically validates the "Columbia University (CU) method," a clinical heuristic that teaches residents to check the probability map first and use b-scans for confirmation.
- Efficiency of Expertise: Experts are "lean" viewers, making significantly fewer fixations than novices but focusing more intensely on high-value areas.
- Gaze as a Proxy for Difficulty: Experts took longer and made more fixations on glaucomatous reports than healthy ones. Novices showed no significant difference, suggesting they may not yet recognize which cases require deeper scrutiny.
- Disease Detection via Gaze: When using only the gaze patterns of experts, the model could identify glaucomatous reports with 64.67% accuracy. While lower than image-based AI, it significantly outperforms chance, proving that expert gaze carries a signal of the underlying pathology.
Conclusion and Future Work
Unsupervised analysis revealed that senior residents’ gaze patterns are much more similar to experts than to junior residents, providing a potential metric for tracking resident progress. While limited by a small sample size, these findings have implications for enhancing ophthalmic education and developing effective diagnostic tools. Future research aims to incorporate fixation duration and saccade velocity into these models to create interactive training tools for ophthalmology residents.
Summary updated