Development of a cloud-assisted classification technique for the preservation of secure data storage in smart cities

Ankit Kumar, Surbhi Bhatia Khan, Saroj Kumar Pandey, Achyut Shankar, Carsten Maple, Arwa A. Mashat, Areej A. MalibariJ. Cloud Comput 2023 · DOI · OpenReview

Introduction

Smart cities have evolved into massive data factories, continuously generating streams of information from IoT sensors, healthcare systems, and urban infrastructure. To manage this volume, data is typically centralized in cloud storage. However, this centralization creates a significant attack surface, making the data vulnerable to sophisticated network intrusions such as DDoS attacks and spambots. Traditional security systems often struggle with the complexity of "Big Data," leading to high false-positive rates and latency issues. This paper, published in the Journal of Cloud Computing, proposes a robust framework to secure these cloud-assisted environments using a hybrid machine learning approach.

Methodology and System Architecture

The researchers developed a multi-stage pipeline designed to transform raw network data into actionable security intelligence. This process begins with data cleaning and integration, moving through a structured selection and transformation phase before reaching the mining and evaluation stages.

The multi-stage data processing pipeline for smart city cloud storage.

The core of the methodology involves three primary technical components:

  1. K-means Clustering: To handle the scale of smart city datasets, the system first groups similar data points. This acts as a dimensionality reduction tool, filtering out computational "noise" and allowing the classifier to focus on organized clusters rather than unstructured data.
  2. The "Novel KNN" Classifier: The standout innovation is a modified K-Nearest Neighbor (KNN) algorithm. Unlike standard KNN, which relies on static Euclidean distance, this version employs dynamic distance measurements via backpropagation. This allows the model to be significantly more sensitive to subtle anomalies and "abnormal nodes" (attackers) within dense traffic.
  3. Integrity Verification: To ensure data remains untampered with after storage, the framework includes a "Store Protocol" utilizing Bitcoin blockchain hashes to generate periodic security challenges.

Experimental Design and Performance

The study compared the performance of the modified KNN against traditional Support Vector Machines (SVM) to determine the most efficient method for real-time cloud monitoring.

Comparative workflow for evaluating KNN and SVM performance.

Using benchmark datasets from the UCI Machine Learning Repository, the Cleveland Database, and real-world Wire Shark network simulations, the researchers evaluated the model's precision and recall. The hybrid approach demonstrated a clear advantage, particularly in identifying specific threats like compromised servers and spambots.

Key Results

  • High Accuracy: The proposed system achieved a peak accuracy of 98.98% in detecting network intrusions.
  • Superiority over Baselines: The hybrid method outperformed existing deep learning and ensemble models, which typically range between 93% and 98.4% accuracy.
  • Efficiency: The KNN-based approach exhibited shorter execution times than SVM-only models, making it highly suitable for the low-latency requirements of smart city infrastructure.

Conclusion and Future Work

While the framework provides a highly accurate solution for intrusion detection, the authors identify several areas for future development. These include the transition toward "green" cloud computing to reduce the energy footprint of security measures and the exploration of ensemble techniques to push accuracy even closer to 100%. Furthermore, while the system excels on benchmark data, future iterations will focus on its generalizability in live, unpredictable urban environments.

Summary updated

Abstract

Cloud computing is the most recent smart city advancement, made possible by the increasing volume of heterogeneous data produced by apps. More storage capacity and processing power are required to process this volume of data. Data analytics is used to examine various datasets, both structured and unstructured. Nonetheless, as the complexity of data in the healthcare and biomedical communities grows, obtaining more precise results from analyses of medical datasets presents a number of challenges. In the cloud environment, big data is abundant, necessitating proper classification that can be effectively divided using machine language. Machine learning is used to investigate algorithms for learning and data prediction. The Cleveland database is frequently used by machine learning researchers. Among the performance metrics used to compare the proposed and existing methodologies are execution time, defect detection rate, and accuracy. In this study, two supervised learning-based classifiers, SVM and Novel KNN, were proposed and used to analyses data from a benchmark database obtained from the UCI repository. Initially, intrusions were detected using the SVM classification method. The proposed study demonstrated how the novel KNN used for distance capacity outperformed previous studies. The accuracy of the results of both approaches is evaluated. The results show that the intrusion detection system (IDS) with a 98.98% accuracy rate produces the best results when using the suggested system.
BibTeX
@article{kumar2023development,
  author = {Ankit Kumar and Surbhi Bhatia Khan and Saroj Kumar Pandey and Achyut Shankar and Carsten Maple and Arwa A. Mashat and Areej A. Malibari},
  title = {{Development of a cloud-assisted classification technique for the preservation of secure data storage in smart cities}},
  journal = {J. Cloud Comput.},
  year = {2023},
  doi = {10.1186/s13677-023-00469-9},
}
Figure