En-PaFlower: An Ensemble Approach using PSO and Flower Pollination Algorithm for Cancer Diagnosis

Sudhir Kumar Senapati, Manish Shrivastava, Satyasundara MahapatraInternational Journal on Recent and Innovation Trends in Computing and Communication 2023 · DOI

TL;DR

This paper introduces "En-PaFlower," a novel ensemble machine learning model for cancer diagnosis. By combining Particle Swarm Optimization (PSO) for feature selection and the Flower Pollination Algorithm (FPA) for optimization, followed by a majority voting ensemble, the model achieves high accuracy in classifying cancer from microarray data.

What Problem Does This Paper Address?

Cancer remains a leading cause of mortality worldwide, and early detection significantly improves patient outcomes. While machine learning (ML) shows great promise in cancer diagnosis, analyzing complex, high-dimensional microarray data presents a significant challenge. This data, rich in genetic information, often contains redundant or irrelevant features, hindering the accuracy and efficiency of diagnostic models. Traditional approaches struggle with this "small sample size problem" and the sheer volume of data, making effective feature selection and robust classification crucial for accurate cancer diagnosis.

Methods

The proposed "En-PaFlower" model tackles these challenges through a multi-stage approach:

  • Feature Selection (PSO): Particle Swarm Optimization (PSO) is employed as the initial feature selection algorithm. PSO is a population-based stochastic optimization technique inspired by the social behavior of bird flocking or fish schooling. It iteratively refines a set of candidate solutions (particles) to find the optimal feature subset.
  • Feature Optimization (FPA): The Flower Pollination Algorithm (FPA) is then used to further optimize the selected features. FPA is a metaheuristic algorithm inspired by the pollination process in flowering plants. It utilizes global and local pollination strategies to explore the search space for the most relevant features.
  • Base Learners: Three established classification algorithms – Support Vector Machine (SVM), Multi-Layer Perceptron (MLP), and Random Forest (RF) – are used as base learners. These algorithms process the optimized feature sets to generate initial predictions.
  • Ensemble Learning (Majority Voting): Finally, a majority voting technique is applied to combine the predictions from the base learners. This ensemble approach aims to improve overall accuracy and robustness by leveraging the collective decision of multiple models.

Datasets

The study utilized three publicly available cancer microarray datasets from the UCI machine learning data repository:

  • Breast Cancer Dataset: Features: 24481, Samples: 97
  • Lung Cancer Dataset: Features: 12533, Samples: 203
  • Ovarian Cancer Dataset: Features: 15154, Samples: 253

Key Insights and Ideas

  • The Power of Hybrid Optimization: Combining PSO for initial feature selection and FPA for refinement appears to be a potent strategy for handling the high dimensionality of microarray data. This two-pronged approach effectively prunes irrelevant features while retaining crucial genetic markers.
  • Ensemble for Robustness: The majority voting ensemble significantly boosts the predictive power by aggregating the strengths of diverse base classifiers (SVM, MLP, RF), leading to more reliable diagnoses.
  • Microarray Data's Diagnostic Potential: The research underscores the immense value of microarray data for cancer diagnosis, provided that effective dimensionality reduction and classification techniques are employed.

Key Results

The En-PaFlower model demonstrated superior performance across all three cancer datasets compared to other hybrid models (PSO+FPA+SVM, PSO+FPA+MLP, and PSO+FPA+RF).

  • Highest Accuracy: The model achieved an impressive highest accuracy of 95.65% for the Ovarian Cancer dataset.
  • Performance Metrics: For Ovarian Cancer, En-PaFlower also reported high precision (96.41%), recall (96.99%), F-1 Score (96.7%), and Specificity (93.1%).
  • Outperformance: The paper highlights significant accuracy improvements over the baseline hybrid models for each dataset, for example, approximately 21.33% higher accuracy for Breast Cancer compared to PSO+FPA+SVM.

Limitations and Future Work

  • Dataset Specificity: The study was conducted on three specific cancer microarray datasets. The robustness of En-PaFlower on a wider variety of cancer types and datasets needs further investigation.
  • Optimizer Exploration: The authors suggest that exploring other metaheuristic algorithms as optimizers could potentially further enhance the performance of the proposed ensemble model.
  • Computational Cost: While not explicitly detailed as a limitation, the multi-stage optimization and ensemble process might incur significant computational costs, which could be a consideration for real-time applications.

Summary updated

Abstract

Machine learning now is used across many sectors and provides consistently precise predictions. The machine learning system is able to learn effectively because the training dataset contains examples of previously completed tasks. After learning how to process the necessary data, researchers have proven that machine learning algorithms can carry out the whole work autonomously. In recent years, cancer has become a major cause of the worldwide increase in mortality. Therefore, early detection of cancer improves the chance of a complete recovery, and Machine Learning (ML) plays a significant role in this perspective. Cancer diagnostic and prognosis microarray dataset is available with the biopsy dataset. Because of its importance in making diagnoses and classifying cancer diseases, the microarray data represents a massive amount. It may be challenging to do an analysis on a large number of datasets, though. As a result, feature selection is crucial, and machine learning provides classification techniques. These algorithms choose the relevant features that help build a more precise categorization model. Accurately classifying diseases is facilitated as a result, which aids in disease prevention. This work aims to synthesize existing knowledge on cancer diagnosis using machine learning techniques into a compact report. Current research work aims to propose an ensemble-based machine learning model En-PaFlower using Particle Swarm Optimization (PSO) as the feature selection algorithm, Flower Pollination algorithm (FPA) as the optimization algorithm with the majority voting algorithm. Finally, the performance of the proposed algorithm is evaluated over three different types of cancer disease datasets with accuracy, precision, recall, specificity, and F-1 Score etc as the evaluation parameters. The empirical analysis shows that the proposed methodology shows highest accuracy as 95.65%.
BibTeX
@article{senapati2023en,
  author = {Sudhir Kumar Senapati and Manish Shrivastava and Satyasundara Mahapatra},
  title = {{En-PaFlower: An Ensemble Approach using PSO and Flower Pollination Algorithm for Cancer Diagnosis}},
  journal = {International Journal on Recent and Innovation Trends in Computing and Communication},
  year = {2023},
  doi = {10.17762/ijritcc.v11i9s.7419},
}
Figure