Joint Semantic Transfer Network for IoT Intrusion Detection

Jiashu Wu, Yang Wang, Binhui Xie, Shuang Li, Hao Dai, Kejiang Ye, Chengzhong Xu

TL;DR

This paper introduces the Joint Semantic Transfer Network (JSTN), a novel approach for effective intrusion detection in large-scale, sparsely labeled IoT environments. By leveraging knowledge from both a rich network intrusion (NI) domain and a smaller IoT intrusion (II) domain, JSTN bridges the significant heterogeneity gap between these domains to improve detection accuracy.

What Problem Does This Paper Address?

The Internet of Things (IoT) is rapidly expanding, bringing convenience but also introducing significant security vulnerabilities. IoT devices are often resource-constrained and lack robust security maintenance, making them prime targets for malicious attacks. Traditional intrusion detection systems (IDS) struggle with IoT due to the scarcity of labeled data, privacy concerns, and the emergence of new attack types. While domain adaptation (DA) techniques have been explored to transfer knowledge from abundant network intrusion (NI) data to scarce IoT intrusion (II) data, existing methods often result in coarse-grained alignment, confounding attack types and hindering detection performance. This paper addresses the challenge of effectively transferring knowledge across heterogeneous domains (NI and II) with limited labeled target data for IoT intrusion detection.

Methods

The JSTN employs a "Joint Semantic Transfer" strategy to achieve fine-grained knowledge transfer. Key components include:

  • Auxiliary Source II Domain: A small-scale IoT intrusion (II) domain is introduced alongside the rich network intrusion (NI) domain. This auxiliary domain helps to "mask" the scenario heterogeneities between NI and II, making domain alignment easier.
  • Scenario Semantic Transfer: This involves two parts:
  • Domain Discriminator: A discriminator is used to confuse source NI and II domains, forcing them to learn a domain-invariant common feature subspace.
  • Distribution Matching: The predicted categorical distributions from the source domains are matched to preserve intrinsic semantic properties and avoid category confounding.
  • Weighted Implicit Semantic Transfer: This technique preserves the correlation knowledge between categories from source to target domains. It dynamically weights the importance of source domains based on their divergence with the target domain, emphasizing those that offer more valuable learning.
  • Hierarchical Explicit Semantic Alignment: This addresses domain divergence from a distance perspective. It includes:
  • Pseudo-label Refiner (PLR): A geometric-aware refiner improves the accuracy of pseudo-labels for unlabeled target data, preventing negative transfer.
  • Global Centroid-Level Alignment: Aligns category-wise centroids across domains.
  • Local Representative-Level Alignment: Selects representatives within categories and minimizes their pairwise divergence for better feature concentration.

Datasets

The paper evaluates JSTN on several well-known intrusion detection datasets:

  • Network Intrusion Datasets:
    • NSL-KDD
    • UNSW-NB15
    • CICIDS2017
  • IoT Intrusion Datasets:
    • UNSW-BOTIOT
    • UNSW-TONIOT

The authors note that for IoT intrusion datasets used as the source II domain, the data amount is intentionally kept smaller (1/6 to 1/2) than the source NI domain to reflect real-world data scarcity. They also vary the ratio of labeled to unlabeled target II data (NTL:NTU) to test performance under extreme label scarcity.

Key Insights and Ideas

  • The Power of an Auxiliary Domain: Introducing a smaller, related domain (source II) can significantly ease the transfer process by bridging the gap between vastly different domains (NI and II). This is a clever way to mitigate the "domain gap" problem.
  • Semantic Transfer is Crucial: Simply aligning feature spaces isn't enough. JSTN's success hinges on explicitly transferring "scenario semantics" (IoT context) and "categorical distribution semantics" (class relationships), leading to more robust and discriminative features.
  • Weighted Importance for Source Domains: Not all source domains contribute equally. Dynamically weighting source domains based on their divergence from the target domain allows the model to focus on the most relevant knowledge, preventing dilution from less useful sources.
  • Hierarchical Alignment for Precision: Combining global centroid alignment with local representative alignment provides a more nuanced and concentrated feature representation, crucial for distinguishing similar attack types.
  • Refining Pseudo-Labels is Key: Directly assigning pseudo-labels can be detrimental. The geometric-aware PLR is a critical component for ensuring that only high-confidence pseudo-labels are used, preventing error accumulation.

Key Results

  • Superior Accuracy: JSTN consistently outperforms state-of-the-art methods, including double-source DA approaches like CWAN and STN, as well as single-source methods and traditional ML learners.
  • Significant Performance Boost: JSTN achieves an average accuracy boost of 10.3% over comparable methods.
  • Robustness under Label Scarcity: The model maintains strong performance even when the ratio of unlabeled to labeled target data is as high as 1:50, demonstrating its effectiveness in truly data-scarce scenarios.
  • Improved Precision, Recall, and F1-Score: Beyond accuracy, JSTN also excels in these crucial metrics, indicating better detection of malicious traffic while minimizing false alarms.
  • Computational Efficiency: JSTN demonstrates efficient training and inference times, outperforming STN and CWAN in per-epoch training speed and per-instance inference time.

Limitations and Future Work

  • Parameter Sensitivity: While JSTN shows relative stability across parameter variations, the paper acknowledges the need to verify parameter sensitivity.
  • Ablation Studies: The paper includes extensive ablation studies, confirming that each semantic transfer component is indispensable. Removing any component leads to performance degradation, highlighting the synergistic nature of the proposed method.
  • Future Work: The paper implicitly suggests that further exploration of different auxiliary domain strategies and more sophisticated semantic transfer mechanisms could yield even better results. The focus on bridging heterogeneity gaps through semantic understanding is a promising direction for future research in domain adaptation for security applications.

Summary updated

Abstract

In this paper, we propose a Joint Semantic Transfer Network (JSTN) towards effective intrusion detection for large-scale scarcely labelled IoT domain. As a multi-source heterogeneous domain adaptation (MS-HDA) method, the JSTN integrates a knowledge rich network intrusion (NI) domain and another small-scale IoT intrusion (II) domain as source domains, and preserves intrinsic semantic properties to assist target II domain intrusion detection. The JSTN jointly transfers the following three semantics to learn a domain-invariant and discriminative feature representation. The scenario semantic endows source NI and II domain with characteristics from each other to ease the knowledge transfer process via a confused domain discriminator and categorical distribution knowledge preservation. It also reduces the source-target discrepancy to make the shared feature space domain-invariant. Meanwhile, the weighted implicit semantic transfer boosts discriminability via a fine-grained knowledge preservation, which transfers the source categorical distribution to the target domain. The source-target divergence guides the importance weighting during knowledge preservation to reflect the degree of knowledge learning. Additionally, the hierarchical explicit semantic alignment performs centroid-level and representative-level alignment with the help of a geometric similarity-aware pseudo-label refiner, which exploits the value of unlabelled target II domain and explicitly aligns feature representations from a global and local perspective in a concentrated manner. Comprehensive experiments on various tasks verify the superiority of the JSTN against state-of-the-art comparing methods, on average a 10.3% of accuracy boost is achieved. The statistical soundness of each constituting component and the computational efficiency are also verified.
BibTeX
@article{wu2022joint,
  author = {Jiashu Wu and Yang Wang and Binhui Xie and Shuang Li and Hao Dai and Kejiang Ye and Chengzhong Xu},
  title = {{Joint Semantic Transfer Network for IoT Intrusion Detection}},
  journal = {IEEE Internet of Things Journal},
  year = {2022},
}
Figure