The DCA: SOMe comparison - A comparative study between two biologically inspired algorithms

Julie Greensmith, Jan Feyereisl, Uwe Aickelin

TL;DR

This paper presents a rigorous head-to-head comparison between the biologically-inspired Dendritic Cell Algorithm (DCA) and the well-established Self-Organizing Map (SOM) for network anomaly detection. The results demonstrate that the DCA is a formidable competitor to traditional neural-inspired techniques, achieving comparable—and in some specific cases, superior—performance in detecting malicious SYN port scans.

What Problem Does This Paper Address?

Artificial Immune Systems (AIS) have long sought to mimic the human body’s ability to detect intruders. However, early AIS approaches, like "negative selection," were often plagued by scalability issues and a flood of false positives.

The Dendritic Cell Algorithm (DCA) was proposed as a "context-aware" alternative based on the Danger Theory of immunology. While early tests of the DCA were promising, it lacked a rigorous benchmark against established machine learning methods. The authors tackle this gap by comparing the DCA against the Self-Organizing Map (SOM), a standard unsupervised learning technique, to determine if this newer, immune-inspired approach can truly hold its own in a cybersecurity context.

Methods

The study compares two distinct biologically-inspired paradigms:

  • The Dendritic Cell Algorithm (DCA): Inspired by the innate immune system, the DCA performs multi-sensor data fusion. It categorizes input signals into three types: PAMPs (certain signs of anomaly), Danger Signals (probable signs of stress), and Safe Signals (indicators of normal behavior). These signals are fused to produce a "Mature Context Antigen Value" (MCAV), which scores how "anomalous" a specific process (antigen) appears over time.
  • Self-Organizing Map (SOM): A neural-inspired clustering method that maps high-dimensional data onto a 2D grid. Anomalies are detected by measuring the distance between new data points and their "Best Matching Unit" (BMU) on the map.

To make the comparison fair, the authors "segmented" the data, grouping antigens into fixed-size windows ($z$) to calculate anomaly scores for both algorithms. They used the Mann-Whitney test to statistically validate whether the performance differences between the two were significant.

Datasets

The authors generated two primary datasets consisting of approximately 13 million data items:

  1. Passive Normal (PN): Contains a SYN port scan (using nmap) performed against a system with minimal background activity.
  2. Active Normal (AN): Contains the same SYN scan but buried under heavy "normal" traffic, including web browsing (Firefox), chat sessions, and email via SSH.

Signals were derived from the Linux /proc filesystem and network statistics, including ICMP error rates, TCP reset packets, and network packet rates.

Key Insights and Ideas

  • Context is King: The DCA’s strength lies in its ability to correlate disparate data streams (signals) with specific actors (antigens). It doesn't just look at a spike in traffic; it asks if that spike is associated with a specific process ID.
  • Shared Blind Spots: Interestingly, both algorithms tended to produce false positives for the same processes. This suggests that certain normal system behaviors inherently mimic the "stress" patterns of an attack, regardless of the detection logic used.
  • The "Danger" Advantage: The DCA showed a statistically significant advantage in detecting the nmap process specifically. The authors suggest this is because the DCA’s signal processing creates a tighter "coupling" between the stress signals and the offending process during the duration of the scan.
  • Sensitivity to Granularity: Both algorithms are highly sensitive to the "segment size" ($z$). Choosing how many data points to aggregate before making a decision is a critical tuning parameter that can make or break detection accuracy.

Key Results

  • Comparable Accuracy: Both the DCA and SOM were equally effective at identifying the presence of SYN-based port scans.
  • Statistical Edge: In the "Active Normal" scenario, the DCA outperformed the SOM in detecting the nmap process with a p-value of 0.0001, indicating the improvement was not due to chance.
  • Baseline Validation: Both algorithms significantly outperformed a standard k-means classifier, which only managed to correctly classify about 52% of the signals, proving the value of their biologically-inspired architectures.

Limitations and Future Work

The authors acknowledge that while the DCA performed well on port scans, its "context-aware" nature needs to be tested on much larger and more diverse datasets, such as those from radio telescopes or more complex network intrusions.

Future research directions include:

  • Dynamic Segmentation: Moving away from fixed window sizes ($z$) to dynamic windows that adapt to system activity.
  • Theoretical Grounding: While the empirical results are strong, a deeper mathematical analysis of the DCA’s data fusion properties is still required to fully understand why it excels in certain scenarios.
  • Real-time Scaling: Testing the libtissue framework (the engine behind their DCA implementation) in high-throughput, real-world environments.

Summary updated

Abstract

The dendritic cell algorithm (DCA) is an immune-inspired algorithm, developed for the purpose of anomaly detection. The algorithm performs multi-sensor data fusion and correlation which results in a ‘context aware’ detection system. Previous applications of the DCA have included the detection of potentially malicious port scanning activity, where it has produced high rates of true positives and low rates of false positives. In this work we aim to compare the performance of the DCA and of a self-organizing map (SOM) when applied to the detection of SYN port scans, through experimental analysis. A SOM is an ideal candidate for comparison as it shares similarities with the DCA in terms of the data fusion method employed. It is shown that the results of the two systems are comparable, and both produce false positives for the same processes. This shows that the DCA can produce anomaly detection results to the same standard as an established technique.
BibTeX
@inproceedings{greensmith2008dca,
  author = {Julie Greensmith and Jan Feyereisl and Uwe Aickelin},
  title = {{The DCA: SOMe comparison - A comparative study between two biologically inspired algorithms}},
  booktitle = {Evol. Intell},
  year = {2008},
  url = {https://openreview.net/forum?id=S9ZGjWiIWq},
}

Loading related content...

Figure