PCA 4 DCA: The Application Of Principal Component Analysis To The Dendritic Cell Algorithm

Feng Gu, Julie Greensmith, Robert F. Oates, Uwe Aickelin

TL;DR

This paper introduces a novel approach to automate the data preprocessing step for the Dendritic Cell Algorithm (DCA) by integrating Principal Component Analysis (PCA). This integration aims to overcome the DCA's reliance on manual, domain-specific data categorization, leading to more objective and potentially more accurate anomaly detection, as demonstrated on a driver stress recognition dataset.

What Problem Does This Paper Address?

The Dendritic Cell Algorithm (DCA), inspired by biological immune systems, is a powerful tool for anomaly detection. However, a significant hurdle in its application is the manual preprocessing of input data. The DCA requires input signals to be categorized into one of three types: PAMP (Pathogen-Associated Molecular Pattern), danger, or safe signals. Traditionally, this categorization relies heavily on domain expertise or manual "over-fitting" of data, which is undesirable as it can introduce bias and limit the algorithm's generalizability. This paper addresses the need for an automated, objective method to perform this crucial data categorization step, thereby making the DCA more accessible and robust.

Methods

The core of this paper is the integration of Principal Component Analysis (PCA) with the Dendritic Cell Algorithm (DCA). The proposed method involves the following key steps:

  1. Data Normalization: All input data attributes are normalized to a [0,1] range using a Min-Max normalization technique. This ensures all features are on a comparable scale.
  2. PCA Ranking and Categorization: PCA is applied to the normalized data (excluding elapsed time and marker attributes). PCA identifies principal components that capture the most variance in the data. The attributes are then ranked based on their variability. This ranking is used to map attributes to the DCA's predefined signal categories (PAMP, danger, safe). The highest-ranked attribute is designated as the "antigen" data.
  3. Antigen Generation: An antigen type is derived from the "elapsed time" attribute. A dynamic antigen multiplier is employed to generate multiple instances of an antigen type per data instance, with the frequency determined by the top-ranked attribute from PCA (in this case, EMG).
  4. DCA Application: The categorized signals and generated antigens are fed into the DCA. The DCA then calculates a "Ka anomaly metric" for each antigen type.
  5. Prediction Assessment: The Ka values are segmented, and an anomaly threshold is applied to determine if a segment is anomalous or normal.
  6. True/False Positive Analysis: ROC curves are generated by calculating true positive and false positive rates across various thresholds.

The novelty lies in using PCA not just for dimensionality reduction but specifically for ranking attributes based on their inherent variability, which is then used to objectively assign them to the DCA's signal categories.

Datasets

The paper utilizes the Stress Recognition in Automobile Drivers dataset from the PhysioBank database. This dataset comprises multiparameter physiological data collected from healthy volunteers driving in various conditions (city streets and highways). The data includes signals such as electrocardiogram (ECG), electromyography (EMG), galvanic skin resistance (GSR), heart rate (HR), and respiration. For their experiments, the authors specifically use the 'driver05' subset. This dataset is not newly introduced but is a well-established benchmark for stress recognition.

Key Insights and Ideas

  • PCA as an Objective Categorizer: The paper demonstrates that PCA can effectively serve as an objective mechanism for categorizing input data for the DCA, replacing the need for manual domain expertise. This is a significant step towards making the DCA more broadly applicable.
  • Variability as Importance: The underlying assumption that attribute variability correlates with importance for anomaly detection proves to be a valid heuristic in this context. Attributes with higher variance are more likely to capture anomalous patterns.
  • Automated Feature Selection for DCA: PCA not only categorizes signals but also implicitly performs a form of feature selection by ranking attributes based on their contribution to data variance. This streamlined preprocessing is crucial for real-time applications.
  • Successful Integration for Stress Detection: The combined PCA-DCA system shows promising results in detecting driver stress, indicating the practical utility of the proposed automated preprocessing approach.

Key Results

The experimental results indicate that the integrated PCA-DCA system successfully categorizes input data and achieves good anomaly detection performance. Specifically:

  • The system demonstrates high true positive rates and low false positive rates, as evidenced by the ROC graph (Figure 4) where most points are located in the top-left corner.
  • The paper highlights that with appropriate thresholds (e.g., Th = -1.5 or Th = -1), the system achieves a true positive rate of 1 and a false positive rate of 0.25 or 0.25, respectively.
  • The authors conclude that the application of PCA to the DCA for automated data preprocessing is successful for the biometrics stress data.

Limitations and Future Work

  • Single Dataset Evaluation: The authors acknowledge that the integrated system has only been tested on one particular biometrics dataset. They suggest that further validation is needed by applying the system to other biometrics datasets with similar features to further validate its robustness.
  • Exploration of Other Techniques: While PCA proved effective, the paper mentions that other statistical techniques, such as N-Gram analysis, could also yield beneficial results, implying that further exploration of alternative preprocessing methods is warranted.
  • Real-time Detection Potential: The paper emphasizes the system's potential for real-time detection due to its automated nature. Future work could focus on optimizing the system for even faster processing and deployment in continuous monitoring scenarios.

Summary updated

Abstract

As one of the newest members in the field of artificial immune systems (AIS), the Dendritic Cell Algorithm (DCA) is based on behavioural models of natural dendritic cells (DCs). Unlike other AIS, the DCA does not rely on training data, instead domain or expert knowledge is required to predetermine the mapping between input signals from a particular instance to the three categories used by the DCA. This data preprocessing phase has received the criticism of having manually over-?tted the data to the algorithm, which is undesirable. Therefore, in this paper we have attempted to ascertain if it is possible to use principal component analysis (PCA) techniques to automatically categorise input data while still generating useful and accurate classication results. The integrated system is tested with a biometrics dataset for the stress recognition of automobile drivers. The experimental results have shown the application of PCA to the DCA for the purpose of automated data preprocessing is successful.
BibTeX
@misc{gu2010pca,
  author = {Feng Gu and Julie Greensmith and Robert F. Oates and Uwe Aickelin},
  title = {{PCA 4 DCA: The Application Of Principal Component Analysis To The Dendritic Cell Algorithm}},
  year = {2010},
  eprint = {1004.3460},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1004.3460},
}
Figure