Retina images classification based on 2D empirical mode decomposition and multifractal analysis

Lei Yang, Minxuan Zhang, Jing Cheng, Tiegang Zhang, Feng LuHeliyon 2024 · DOI

TL;DR

This paper introduces a novel method for classifying retinal images to detect diabetic retinopathy by combining 2D Empirical Mode Decomposition (EMD) with multifractal analysis. This approach effectively captures the complex textural changes in the retina caused by the disease, achieving high accuracy in distinguishing between healthy and diseased individuals.

What Problem Does This Paper Address?

Diabetic retinopathy, a serious complication of diabetes, damages the retina's microvasculature, leading to subtle yet significant changes in its morphology. Traditional image analysis methods often struggle to accurately describe these complex, non-geometric changes. The challenge lies in developing robust techniques that can quantify these subtle textural differences to enable early and accurate diagnosis of diabetic retinopathy.

Methods

The core of this research lies in a two-step process:

  1. 2D Empirical Mode Decomposition (EMD): The authors extend the one-dimensional EMD to a two-dimensional version. EMD is a data-driven technique that decomposes a signal into a set of intrinsic mode functions (IMFs), representing different frequency components. The 2D EMD here is used to break down retinal images into various detailed components, effectively isolating high-frequency features that might be indicative of disease. A key aspect is the adaptation of the stopping criterion for the decomposition process to suit 2D data.
  2. Multifractal Analysis: After obtaining the IMFs from the 2D EMD, the researchers apply multifractal analysis to the most informative IMF (specifically, IMF1, which captures high-frequency details). Multifractal analysis is a powerful tool for characterizing complex, self-similar structures at multiple scales. It quantifies the heterogeneity and singularity of textures by analyzing fractal dimensions. The paper uses the box-counting method to calculate various multifractal parameters.

Finally, these extracted multifractal features are fed into a Random Forest classifier for the actual classification of retinal images into healthy or diseased categories. Feature importance analysis is also performed to identify the most discriminative parameters.

Datasets

The study utilized two datasets:

  • Drive Dataset: This dataset consists of 60 fundus images, with 20 images from healthy individuals and 40 from patients with diabetic retinopathy. These images were resized to 224x224 pixels.
  • Standard Diabetic Retinopathy Database: A larger, open-source database comprising 35,126 retina scan images. This dataset was used to further validate the findings and provided a broader range of disease severities (mild, moderate, severe, and proliferative DR).

Key Insights and Ideas

  • 2D EMD for Retina Texture: Extending EMD to two dimensions proves effective in extracting detailed, high-frequency textural information from retinal images, which is crucial for identifying subtle disease-related changes.
  • Multifractal Signatures of Diabetic Retinopathy: The study highlights that retinas affected by diabetic retinopathy exhibit distinct multifractal characteristics compared to healthy retinas. This suggests that the disease significantly alters the complex, self-similar structure of the retinal microvasculature.
  • IMF1 as the Key Component: The research found that the first intrinsic mode function (IMF1) obtained from 2D EMD contains the most relevant high-frequency details and exhibits stronger fractal characteristics, making it the most suitable component for multifractal analysis in this context.
  • Feature Importance for Classification: The Random Forest algorithm successfully identified key multifractal parameters (like $\Delta\alpha$, $a_{max}$, and $D_0$) that are most influential in distinguishing between healthy and diseased retinas.

Key Results

The proposed method achieved impressive performance:

  • Classification Accuracy: 96.24%
  • Sensitivity: 95.56%
  • Specificity: 95.38%

These results are competitive with or superior to several state-of-the-art methods presented in the paper's comparison table. The study also demonstrated that the multifractal spectrum of diabetic patients' retinas shows a longer right tail compared to healthy individuals, indicating differences in periodic intensity and texture.

Limitations and Future Work

  • Dataset Size: While the study used two datasets, the primary dataset for detailed analysis consisted of only 60 images. The authors acknowledge that the quality and size of the dataset are major limitations.
  • Generalizability: The paper focuses on retinal images. Future work could explore the application of this 2D EMD and multifractal analysis approach to other medical imaging modalities or even three-dimensional object morphology.
  • Clinical Translation: The authors suggest that this method could be a promising clinical system for classifying pathological patterns in biological tissues, implying a need for further validation and integration into clinical workflows.

Summary updated

Abstract

Diabetic retinopathy is an ocular disease caused by long-term damage to the retina due to high blood sugar levels. Elevated blood sugar can impair the microvasculature in the retina, leading to vascular abnormalities and the formation of abnormal new blood vessels. These changes can manifest in the retina as hemorrhages, leaks, vessel dilation, retinal edema, and retinal detachment. The retinas of individuals with diabetes exhibit different morphologies compared to those without the condition. Most histological images cannot be accurately described using traditional geometric shapes or methods. Therefore, this study aims to evaluate and classify the morphology of retinas with varying degrees of severity using multifractal geometry. In the initial experiments, two-dimensional empirical mode decomposition was employed to extract high-frequency detailed features, and the classification process was based on the most relevant features in the multifractal spectrum associated with disease factors. To eliminate less significant features, the random forest algorithm was utilized. The proposed method achieved an accuracy of 96%, sensitivity of 96%, and specificity of 95%.
BibTeX
@inproceedings{yang2024retina,
  author = {Lei Yang and Minxuan Zhang and Jing Cheng and Tiegang Zhang and Feng Lu},
  title = {{Retina images classification based on 2D empirical mode decomposition and multifractal analysis}},
  booktitle = {Heliyon},
  year = {2024},
  doi = {10.1016/j.heliyon.2024.e27391},
}
Figure