Zero-Bias Deep Learning for Accurate Identification of Internet of Things (IoT) Devices

Yongxin Liu, Jian Wang, Jianqiang Li, Houbing Song, Thomas Yang, Shuteng Niu, Zhong MingIEEE Internet of Things Journal 2020 · DOI · OpenReview

TL;DR

This paper introduces a novel "zero-bias" deep learning layer for more robust and interpretable identification of Internet of Things (IoT) devices, addressing the critical security threat of identity spoofing. By analyzing physical-layer radio signals, their method can accurately identify known devices and, crucially, flag unknown ones, enhancing IoT security without relying on traditional cryptography.

What Problem Does This Paper Address?

The Internet of Things (IoT) is rapidly expanding, connecting billions of devices that offer unprecedented convenience and functionality. However, this interconnectedness also creates significant security vulnerabilities. One major threat is "identity spoofing," where malicious actors intercept legitimate device communications and then impersonate those devices to conduct harmful activities. Traditional security measures like cryptographic signatures, which rely on secret keys, are often impractical or too expensive to implement in the diverse and resource-constrained IoT ecosystem. Furthermore, existing non-cryptographic methods for device identification struggle with two key challenges: accurately identifying devices they haven't seen before (unseen device recognition) and providing clear explanations for their decisions (model interpretability). This paper aims to bridge this gap by proposing a deep learning framework that is both accurate and interpretable for IoT device identification, specifically tackling the issue of unseen devices.

Methods

The core innovation presented is the zero-bias dense layer, a modification to the final dense layer in deep neural networks. This new layer is designed to enhance interpretability and robustness without sacrificing accuracy. The framework first processes raw radio signals through convolutional layers to extract latent features. Then, instead of a standard dense layer followed by a softmax, it employs a two-stage approach:

  1. Regular Dense Layer (L1): This layer performs a linear transformation on the input features, similar to a conventional dense layer, but without a bias term.
  2. Zero-Bias Similarity Layer (L2): This layer calculates the cosine similarity between the output of L1 and learned "fingerprint" vectors for each class. This effectively measures how well the input signal's features align with the characteristics of known device types.

The paper also details methods for feature extraction from baseband signals. This includes:

  • Pseudo-Noise Extraction: This technique aims to isolate message-independent components of the signal by using a k-medoids clustering algorithm to identify representative signal characteristics (medoids) and then subtracting them from the original signal. The idea is that the residual signal (pseudo-noise) contains the device's unique physical-layer "fingerprint."
  • Frequency Domain Features: Fourier Transforms are used to extract message-uncorrelated residual components in the frequency domain, resulting in magnitude and phase features.

The zero-bias layer's design allows it to directly output similarity scores, which can then be used for classification. Crucially, by analyzing these similarity scores, the system can also detect unknown devices by setting a threshold below which a signal is flagged as anomalous.

Datasets

The primary dataset used for evaluation is real-world ADS-B (Automatic Dependent Surveillance-Broadcast) data. ADS-B is an aviation system where aircraft broadcast their position, velocity, and other identifying information. The authors collected this data using a Software-Defined Radio (SDR) receiver at Daytona Beach International Airport. They collected over 30,000 ADS-B messages from more than 140 aircraft. This dataset is described as a "great variety of signals from known wireless devices" and is used to demonstrate the framework's effectiveness in a practical IoT application. No new benchmark datasets were introduced.

Key Insights and Ideas

  • Physical Layer as a Fingerprint: The fundamental insight is that the unique manufacturing imperfections of wireless transmitters leave discernible "radiometric fingerprints" on the signals they emit. These fingerprints are independent of the transmitted message itself and can be used for identification.
  • Zero-Bias for Interpretability: The "zero-bias" layer is not just about removing bias terms; it's about fundamentally changing how the final layer operates. By forcing the layer to compute similarity scores, it makes the network's decision-making process more transparent. The output directly reflects the degree of match between the input signal and known device profiles.
  • Unseen Device Detection is Crucial: A major contribution is the explicit focus on identifying devices not seen during training. The similarity scores generated by the zero-bias layer provide a natural mechanism for anomaly detection, allowing the system to flag potential spoofing attempts by unknown devices.
  • Cosine Similarity as a Core Mechanism: The paper highlights how the final dense layer in many neural networks implicitly computes a form of cosine similarity. By making this explicit and removing the bias, they simplify the network and improve its interpretability.
  • Generalizability: The authors suggest that the zero-bias layer's principles can be generalized beyond IoT device identification to other domains like virus detection or unsupervised intrusion detection.

Key Results

  • High Accuracy for Known Devices: The deep learning model achieved an accuracy greater than 94.3% for identifying known ADS-B transmitters.
  • Effective Unseen Device Detection: The zero-bias DNN demonstrated superior performance in anomaly detection compared to a regular DNN and a one-class SVM. The similarity responses of unknown signals were clearly distinguishable from known ones, allowing for effective threshold-based detection.
  • Efficient Training Data Usage: The model could recognize each transmitter with as few as 200 samples in the training set.
  • Improved Training Stability: While the zero-bias layer might require more training iterations initially, it showed comparable final accuracy to a regular dense layer and was essential for convergence when compared to a direct cosine similarity approach without the preceding regular dense layer.
  • Reduced Model Complexity: The zero-bias layer approach requires storing directional fingerprints (less than 200) compared to the thousands of support vectors needed by a one-class SVM, making it more adaptable for real-time machine learning.

Limitations and Future Work

  • Training Iterations: The zero-bias layer requires more training iterations compared to a regular dense layer, and its initial accuracy rise is slower.
  • Generalization to Other Domains: While the authors propose generalization, extensive validation in other domains is future work.
  • Real-time Performance Optimization: The paper focuses on the framework's accuracy and interpretability. Further work could explore optimizing its real-time performance for even more demanding IoT applications.
  • Protocol Agnosticism: The framework is designed to be protocol-agnostic by focusing on physical-layer signals. However, the paper acknowledges that the effectiveness of the pseudo-noise extraction relies on the residual signal being uncorrelated with the message. Further research could explore the robustness of this assumption across a wider range of protocols and signal types.

Summary updated

Abstract

The Internet of Things (IoT) provides applications and services that would otherwise not be possible. However, the open nature of IoT make it vulnerable to cybersecurity threats. Especially, identity spoofing attacks, where an adversary passively listens to existing radio communications and then mimic the identity of legitimate devices to conduct malicious activities. Existing solutions employ cryptographic signatures to verify the trustworthiness of received information. In prevalent IoT, secret keys for cryptography can potentially be disclosed and disable the verification mechanism. Non-cryptographic device verification is needed to ensure trustworthy IoT. In this paper, we propose an enhanced deep learning framework for IoT device identification using physical layer signals. Specifically, we enable our framework to report unseen IoT devices and introduce the zero-bias layer to deep neural networks to increase robustness and interpretability. We have evaluated the effectiveness of the proposed framework using real data from ADS-B (Automatic Dependent Surveillance-Broadcast), an application of IoT in aviation. The proposed framework has the potential to be applied to accurate identification of IoT devices in a variety of IoT applications and services. Codes and data are available in IEEE Dataport.
BibTeX
@article{liu2020zero,
  author = {Yongxin Liu and Jian Wang and Jianqiang Li and Houbing Song and Thomas Yang and Shuteng Niu and Zhong Ming},
  title = {{Zero-Bias Deep Learning for Accurate Identification of Internet of Things (IoT) Devices}},
  journal = {IEEE Internet of Things Journal},
  year = {2020},
  doi = {10.1109/jiot.2020.3018677},
}
Figure