Multi-Layered Filtration Framework for Efficient Detection of Network Attacks Using Machine Learning

Muhammad Arsalan Paracha, Muhammad Sadiq, Junwei Liang, Muhammad Hanif Durad, Muhammad SheerazSensors 2023 · DOI

TL;DR

This paper introduces a novel "Multi-Layered Filtration Framework" (MLFF) that significantly reduces the time it takes for intrusion detection systems (IDS) to identify network attacks. By employing a three-stage statistical feature reduction process, the MLFF achieves this speedup without sacrificing detection accuracy, making it more practical for real-world, high-traffic network environments.

What Problem Does This Paper Address?

In today's interconnected world, cybersecurity is paramount. Intrusion Detection Systems (IDS) are crucial for identifying and mitigating network attacks. While much research has focused on improving the accuracy of these systems, a critical aspect often overlooked is efficiency, specifically the time it takes to detect an attack. In high-volume network traffic, slow detection can mean the difference between preventing an attack and suffering significant damage. This paper aims to bridge this gap by developing a framework that prioritizes reducing detection time while maintaining high accuracy.

Methods

The core of this work is the Multi-Layered Filtration Framework (MLFF), a sequential process designed to reduce the number of features used by machine learning models for intrusion detection. It comprises three distinct filters:

  • Filter 1 (Domain Knowledge): This initial filter removes features that are highly dependent on the specific network environment or testing setup. Examples include FlowID, Source IP, and Timestamp, which can change frequently and might not generalize well to different networks. This step leverages expert knowledge about network traffic characteristics.
  • Filter 2 (Statistical Significance): This filter employs statistical methods, specifically Spearman's rank correlation coefficient and p-value testing, to identify and remove features that have a non-linear, insignificant correlation with the target variable (attack vs. normal traffic). The goal is to eliminate features that don't contribute meaningfully to the detection model's learning process.
  • Filter 3 (Multicollinearity Detection): This final filter addresses the issue of multicollinearity, where independent features are highly correlated with each other. Using the Variance Inflation Factor (VIF) method, it identifies and removes redundant features that could lead to model overfitting and instability.

After these filters are applied, the remaining features are used to train and evaluate machine learning models.

Datasets

The primary dataset used in this research is the CIC-IDS2017 dataset. This dataset is widely recognized and publicly available, generated from real network traffic capturing both normal and various attack scenarios. It contains 84 features and is known for its comprehensive representation of different attack types. The paper does not introduce a new benchmark dataset.

Key Insights and Ideas

  • Feature Reduction is Key to Efficiency: The paper strongly demonstrates that systematically reducing the number of features, even those that might seem informative in a controlled environment, can drastically improve detection speed without harming accuracy.
  • Layered Approach for Robustness: The multi-layered filtration, combining domain knowledge, statistical significance, and multicollinearity checks, provides a robust way to select the most relevant and independent features.
  • Trade-offs Matter: While accuracy is important, the paper highlights that for real-time intrusion detection, a slight dip in accuracy might be acceptable if it leads to a substantial reduction in detection time.
  • Not All Features Are Equal: Features like IP addresses and timestamps, while seemingly important, can be highly environment-specific and are often the first to be discarded in favor of more generalized indicators of malicious activity.

Key Results

The MLFF successfully reduced the initial 83 features down to just 26. When tested with various machine learning models:

  • Random Forest (RF) achieved an accuracy of 99.42% with a detection time of 0.78 seconds. This is a significant improvement in detection time compared to previous studies (e.g., 6.76 seconds in [24]).
  • Decision Tree (DT) also performed well, achieving 99.27% accuracy with an exceptionally low detection time of 0.02 seconds, a dramatic reduction from 1.12 seconds in [24].
  • Artificial Neural Network (ANN) showed 98.15% accuracy with a detection time of 0.03 seconds, a substantial speedup from 48.03 seconds in [24].
  • Models like K-Nearest Neighbor (KNN) and Support Vector Machine (SVM) showed high accuracy but had impractically long detection times (91.3s and 201s respectively).

The ablation study confirmed that all three filters contribute to the overall performance, with the sequential application of F1, F2, and F3 yielding the best results in terms of both accuracy and detection time.

Limitations and Future Work

  • Limitations: The authors acknowledge that the proposed framework has limitations, particularly in scenarios with extremely high traffic volumes, where the system might not operate at an adequate speed. Additionally, the study is limited to the network attacks present in the CICIDS2017 dataset.
  • Future Work:
    • Advanced Datasets: Explore newer datasets like CIC-IDS2018 to further optimize the model.
  • Broader Attack Spectrum: Incorporate a wider range of attack types, including those from different network layers, to enhance the MLFF's ability to detect sophisticated and multi-faceted attacks.
  • High-Performance Computing: Utilize more powerful hardware (e.g., high-performance servers) to accelerate training and detection, enabling near real-time analysis.
  • Integration with SIEM: Integrate multiple detection frameworks into a centralized Security Information and Event Management (SIEM) system to improve the overall security ecosystem.

Summary updated

Abstract

The advancements and reliance on digital data necessitates dependence on information technology. The growing amount of digital data and their availability over the Internet have given rise to the problem of information security. With the increase in connectivity among devices and networks, maintaining the information security of an asset has now become essential for an organization. Intrusion detection systems (IDS) are widely used in networks for protection against different network attacks. Several machine-learning-based techniques have been used among researchers for the implementation of anomaly-based IDS (AIDS). In the past, the focus primarily remained on the improvement of the accuracy of the system. Efficiency with respect to time is an important aspect of an IDS, which most of the research has thus far somewhat overlooked. For this purpose, we propose a multi-layered filtration framework (MLFF) for feature reduction using a statistical approach. The proposed framework helps reduce the detection time without affecting the accuracy. We use the CIC-IDS2017 dataset for experiments. The proposed framework contains three filters and is connected in sequential order. The accuracy, precision, recall and F1 score are calculated against the selected machine learning models. In addition, the training time and the detection time are also calculated because these parameters are considered important in measuring the performance of a detection system. Generally, decision tree models, random forest methods, and artificial neural networks show better results in the detection of network attacks with minimum detection time.
BibTeX
@inproceedings{paracha2023multi,
  author = {Muhammad Arsalan Paracha and Muhammad Sadiq and Junwei Liang and Muhammad Hanif Durad and Muhammad Sheeraz},
  title = {{Multi-Layered Filtration Framework for Efficient Detection of Network Attacks Using Machine Learning}},
  booktitle = {Sensors},
  year = {2023},
  doi = {10.3390/s23135829},
}
Figure