CNN-Based Retinal OCT Classification: Research Gap Analysis and a From-Scratch Baseline, ED126-A

Shkelqim SherifiarXiv 2026 · arXiv

TL;DR

This paper introduces ED126-A, a compact, purpose-built CNN designed to serve as a transparent "from-scratch" baseline for retinal OCT image classification. By achieving 95.03% accuracy without transfer learning or complex ensembles, the authors expose how aggregate metrics can mask significant diagnostic failures in specific disease categories like Drusen.

What Problem Does This Paper Address?

Optical Coherence Tomography (OCT) is a vital tool for diagnosing retinal diseases like Choroidal Neovascularization (CNV) and Diabetic Macular Edema (DME). While many deep learning models report near-perfect accuracy on benchmark datasets, the field suffers from a "comparison crisis."

Researchers often use different data splits, varying levels of augmentation, and pre-trained models (transfer learning), making it impossible to tell if a performance boost comes from a clever new architecture or simply a better starting point. Furthermore, high overall accuracy often hides the fact that a model might be terrible at distinguishing between two visually similar pathologies. The authors argue that the field lacks a well-documented, compact, and "clean" baseline to measure future progress against.

Methods

The authors developed ED126-A, a relatively small convolutional neural network with only 1.24 million parameters—a fraction of the size of standard models like VGG-16 (138M) or ResNet-50 (25M).

Key methodological choices include:

  • Training from Scratch: The model was initialized with random weights, avoiding the "black box" influence of ImageNet pre-training.
  • Hierarchical Architecture: Four progressively deepening convolutional blocks (32 to 256 filters) followed by a Global Average Pooling (GAP) head to keep the parameter count low.
  • Robust Augmentation: To simulate real-world clinical variability, the team implemented a stochastic pipeline including horizontal flips, small rotations, translations, and contrast shifts.
Fig. 4. Preprocessing and training-time augmentation pipeline for retinal OCT images.
  • Multi-faceted Evaluation: Beyond just accuracy, they used t-SNE for feature visualization, Grad-CAM for interpretability, and detailed Precision-Recall analysis to find where the model "stumbles."

Datasets

The study utilized the Kermany labeled OCT dataset, a standard benchmark in the field.

  • Composition: 109,309 grayscale OCT B-scans.
  • Classes: Four categories—CNV, DME, Drusen, and Normal.
  • Partitioning: A 70/20/10 split for training, validation, and testing.
Fig. 2. Class distribution of the retinal OCT dataset across CNV, DME, Drusen, and Normal categories.

Key Insights and Ideas

  • The "Drusen Trap": The most significant finding was a precision-recall asymmetry. While the model was great at finding Drusen (96% recall), it suffered from a high false-positive rate (75% precision). It frequently confused Normal and CNV scans for Drusen.
  • ROC-AUC is Deceptive: The model achieved a near-perfect ROC-AUC of 0.993 for Drusen. However, the Precision-Recall (PR) curve told a different story, showing significant degradation. This highlights why researchers shouldn't rely on ROC-AUC alone when classes are imbalanced or morphologically similar.
  • Boundary Ambiguity: t-SNE visualizations revealed that misclassifications weren't random outliers; they clustered at the boundaries where different disease features physically overlap in the feature space.
  • Compactness vs. Performance: The study proves that a model doesn't need tens of millions of parameters to achieve high performance on OCT data, suggesting that many current models may be unnecessarily over-parameterized.
Fig. 5. Representative grayscale OCT images from the training set across the four diagnostic classes.

Key Results

  • Overall Accuracy: 95.03% on the held-out test set.
  • F1-Scores: 0.9774 (Normal), 0.9580 (CNV), 0.9047 (DME), and a much lower 0.8419 (Drusen).
  • Error Channels: The confusion matrix identified CNV → Drusen (176 cases) and Normal → Drusen (96 cases) as the primary sources of error.
  • Training Efficiency: The model reached its best performance at epoch 27 using a single NVIDIA T4 GPU, demonstrating that high-quality medical AI research can be done with modest hardware.

Limitations and Future Work

The authors acknowledge several constraints:

  1. Image-level Splitting: The data was split by image rather than by patient. This means images from the same patient could appear in both training and testing, which might lead to an overestimation of real-world clinical performance.
  2. Single-Dataset Evaluation: The model was only tested on the Kermany cohort. Cross-dataset validation is needed to ensure the model generalizes to different scanners and populations.
  3. Interpretability Scope: The Grad-CAM analysis was limited to CNV examples; future work needs to investigate the "visual logic" the model uses for the other three classes.
  4. Calibration: The model's output probabilities aren't yet "calibrated," meaning a 90% confidence score might not strictly represent a 90% probability of disease.

This baseline now provides a "clean room" environment for testing whether adding attention mechanisms or multi-scale feature fusion actually provides a meaningful benefit.

Summary updated

Abstract

Automated classification of retinal pathologies from Optical Coherence Tomography (OCT) images remains challenging because diagnostically relevant morphological patterns may exhibit substantial inter-class similarity. Although high classification accuracies have been reported on benchmark OCT datasets, cross-study comparison is limited by heterogeneous evaluation protocols and by the limited characterization of compact convolutional neural network (CNN) baselines trained from random initialization. This study addresses this gap through two contributions. First, it provides a focused review of CNN-based retinal OCT classification and identifies methodological considerations relevant to controlled benchmarking. Second, it presents ED126-A, a purpose-built four-class CNN baseline trained from scratch under a documented experimental protocol on the Kermany labeled OCT dataset. The model contains 1,241,380 total parameters, including 1,239,460 trainable parameters, and is evaluated using training-dynamics analysis, class-wise performance metrics, confusion-matrix analysis, confidence analysis, t-SNE representation-space visualization, Grad-CAM, hierarchical feature-map analysis, and one-vs-rest ROC/Precision-Recall analysis. On the image-level held-out test set, ED126-A achieved 95.03% accuracy, with a macro-F1 of 0.9205 and a weighted-F1 of 0.9521. The principal class-conditional limitation occurred for Drusen, which attained a recall of 0.9605 but a precision of 0.7493 and an F1-score of 0.8419. The confusion matrix identified Normal to Drusen and CNV to Drusen as major error channels. These results support the use of ED126-A as a documented from-scratch reference baseline and provide an empirical basis for controlled evaluation of transfer learning, increased depth, attention, multi-scale feature fusion, and calibration in subsequent studies.
BibTeX
@misc{sherifi2026cnn,
  author = {Shkelqim Sherifi},
  title = {{CNN-Based Retinal OCT Classification: Research Gap Analysis and a From-Scratch Baseline, ED126-A}},
  year = {2026},
  eprint = {2611.02114},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.02114},
}
Figure