Self-Attentive Models for Real-Time Malware Classification

Qikai Lu, Hongwen Zhang, Husam Kinawi, Di Niu

Abstract

Malware classification is a critical task in cybersecurity, as it offers insights into the threats that malware poses to the victim device and helps in the design of countermeasures. For real-time malware classification, due to the high network throughputs of modern networks, there is a challenge of achieving high classification accuracy while maintaining low inference latency. We first introduce two self-attention transformer-based classifiers, SeqConvAttn and ImgConvAttn, to replace the currently predominant Convolutional Neural Network (CNN) classifiers. We then devise a file-size-aware two-stage framework to combine the two proposed models, thereby controlling the tradeoff between accuracy and latency for real-time classification. To assess our proposed designs, we conduct experiments on three malware datasets: the Microsoft Malware Classification Challenge (BIG 2015) and two selected subsets from the BODMAS PE malware dataset, BODMAS-11 and BODMAS-49. We show that our transformer-based designs can achieve better classification accuracy than traditional CNN-based designs. Furthermore, we show that the proposed two-stage framework reduces the average model inference latency while maintaining superior accuracy, thereby fulfilling the requirements of real-time classification.
BibTeX
@inproceedings{lu2022self,
  author = {Qikai Lu and Hongwen Zhang and Husam Kinawi and Di Niu},
  title = {{Self-Attentive Models for Real-Time Malware Classification}},
  booktitle = {IEEE Access},
  year = {2022},
  url = {https://openreview.net/forum?id=eKwhv1YYVy9},
}

Loading related content...

Figure