Common Knowledge Based and One-Shot Learning Enabled Multi-Task Traffic Classification

Haifeng Sun, Yunming Xiao, Jing Wang 0039, Jingyu Wang 0001, Qi Qi, Jianxin Liao, Xiulei LiuIEEE Access 2019 · DOI

Introduction

In the evolving landscape of Software-Defined Networking (SDN), the ability to accurately classify network traffic is fundamental to maintaining Quality of Service (QoS) and ensuring network security. Traditionally, traffic classification has been treated as a series of isolated problems. For instance, separate models might be deployed to detect "elephant flows" (large, long-duration transfers), identify specific applications (e.g., streaming vs. peer-to-peer), or predict flow duration.

However, this siloed approach is increasingly inefficient. It introduces significant redundancy, as multiple models often process the same underlying features. Furthermore, deep learning models are notoriously "data-hungry," requiring massive labeled datasets that are expensive to collect. Finally, these models lack flexibility; when a new classification requirement arises, engineers are often forced to start the training process from scratch.

Proposed Architecture: Multi-Output DNN

To address these challenges, researchers have developed a Multi-Output Deep Neural Network (DNN) architecture that leverages "common knowledge" across multiple classification tasks. The core idea is that different traffic classification goals are inherently related. By forcing a single model to learn multiple tasks simultaneously, it develops a more robust and generalized understanding of traffic behavior.

The proposed architecture consists of two primary components:

  1. Common Layers: A shared backbone that extracts general, "neutral" features from raw traffic data. This acts as a universal feature extractor.
  2. Private Branches: Task-specific layers that branch off from the backbone to handle individual classification objectives.
The Multi-Output DNN architecture featuring shared common layers and task-specific private branches.

Training and Methodology

The study utilized several prominent real-time network traffic trace datasets, including WITS (ISPDSL-I and ISPDSL-II) and the Moore and Zuev datasets. From these, the authors extracted 16 core features, such as transport layer ports, packet counts with PUSH flags, and statistical properties of inter-arrival times.

To optimize the training of the Multi-Output DNN, two specific algorithms were introduced:

  • Round-Robin Backpropagation (RRBP): Tasks are updated sequentially in a cycle.
  • Parallel-Private and Sum-Common Backpropagation (PPSCBP): This method updates private branches in parallel while the common layers receive a summed update from all tasks. PPSCBP proved to be significantly more efficient, allowing the model to converge 2 to 3 times faster than training three separate single-task models.

Key Results and One-Shot Learning

The Multi-Output DNN consistently outperformed or matched traditional machine learning methods (such as kNN, SVM, and Random Forest) and standard single-task DNNs across all tested datasets.

The most significant breakthrough, however, is the model's capability for one-shot learning. When presented with a brand-new classification task and only 1% of the typical training data, standard DNNs struggled, achieving only 70–80% accuracy. In contrast, the Multi-Output DNN—leveraging its pre-trained "common knowledge" backbone—maintained an accuracy of approximately 94%. This suggests that the shared layers learn a "neutral" representation of network traffic that serves as a powerful foundation for new tasks.

Conclusion and Future Directions

By moving away from isolated models toward a multi-tasking framework, this research demonstrates that "common knowledge" can significantly enhance the efficiency and adaptability of network traffic classification. The Multi-Output DNN not only reduces computational redundancy but also enables rapid adaptation to new network demands with minimal data.

Future research may explore automating the weight-balancing between different task branches and testing the model's performance against encrypted traffic, where feature extraction presents a more complex challenge.

Summary updated

BibTeX
@article{sun2019common,
  author = {Haifeng Sun and Yunming Xiao and Jing Wang and Jingyu Wang and Qi Qi and Jianxin Liao and Xiulei Liu},
  title = {{Common Knowledge Based and One-Shot Learning Enabled Multi-Task Traffic Classification}},
  journal = {IEEE Access},
  year = {2019},
  doi = {10.1109/access.2019.2904039},
}
Figure