EdgeMap: An Optimized Mapping Toolchain for Spiking Neural Network in Edge Computing

Jianwei Xue, Xie Li-sheng, Faquan Chen, Liangshun Wu, Qingyang Tian, Yifan Zhou, Rendong Ying, Peilin LiuSensors 2023 · DOI

TL;DR

This paper introduces EdgeMap, a novel toolchain for efficiently deploying Spiking Neural Networks (SNNs) onto resource-constrained edge devices. EdgeMap significantly improves energy efficiency, reduces communication costs, and boosts throughput compared to existing methods, making SNNs more practical for real-world edge applications.

What Problem Does This Paper Address?

Spiking Neural Networks (SNNs) hold immense promise for edge computing due to their inherent energy efficiency and intelligent capabilities. However, deploying these networks onto neuromorphic hardware at the edge is challenging. Current mapping schemes often suffer from long execution times, low throughput, and fail to adequately address the critical constraints of edge devices, such as limited energy and computational power. This gap hinders the widespread adoption of SNNs for intelligent edge applications.

Methods

EdgeMap tackles this challenge with a two-stage approach:

  • Partitioning: It employs a "streaming-based graph partition algorithm" to divide the SNN into small, manageable neuron clusters. This partitioning is constrained by the physical neuron cores available on the target hardware. The goal is to minimize inter-cluster spike communication.
  • Mapping: A "multi-objective optimization algorithm" (specifically NSGA-II) is used to map these neuron clusters onto the neuromorphic cores. This optimization aims to simultaneously minimize energy consumption and communication costs, striking a balance between these critical factors for efficient deployment.

Datasets

The paper evaluates EdgeMap on several standard datasets, converted into SNN-compatible formats:

  • MNIST: Used for both MLP and LeNet-based SNNs (MNIST-MLP, MNIST-LeNet).
  • Fashion-MNIST: An MLP-based SNN for this dataset.
  • Heart Class: An application for ECG-based heartbeat classification.
  • CIFAR-10: Evaluated with four different SNN architectures: LeNet, AlexNet, VGG11, and ResNet.

Key Insights and Ideas

  • Edge-Specific Optimization is Crucial: Unlike many existing methods focused on server-grade hardware, EdgeMap's core innovation lies in its explicit focus on the unique constraints of edge devices (energy, latency, communication).
  • Partitioning Matters for Efficiency: The streaming-based partitioning algorithm is key to reducing communication overhead before mapping, which directly impacts energy and latency.
  • Multi-Objective Optimization Pays Off: Directly optimizing for both energy and communication costs simultaneously, rather than treating them as secondary, leads to significant performance gains.
  • Scalability is Demonstrated: EdgeMap's performance improvements become more pronounced with larger and more complex SNNs, indicating its suitability for demanding edge tasks.

Key Results

EdgeMap demonstrates substantial improvements over state-of-the-art mapping schemes:

  • Energy Consumption: Reduced by up to 57% compared to other methods.
  • Communication Cost: Reduced by up to 58%.
  • Average Latency: Reduced by up to 19.8%.
  • Throughput: Increased by up to 4.02×.
  • Execution Time: Achieved an impressive enhancement by a factor of 1225.44×.

Limitations and Future Work

The authors acknowledge several limitations:

  • Static Optimization: Current EdgeMap relies on static optimization, which might not be ideal for edge scenarios requiring dynamic adjustments based on environmental changes or task requirements.
  • Hardware Homogeneity Assumption: The model assumes all edge devices have equal computational power and does not account for geographical factors that can influence communication latency.

Future work includes:

  • Incorporating more flexible optimization objectives to handle dynamic edge environments.
  • Exploring methods for mapping SNNs with online learning capabilities onto edge devices.
  • Addressing variations in hardware capabilities and geographical influences in future iterations.

Summary updated

Abstract

Spiking neural networks (SNNs) have attracted considerable attention as third-generation artificial neural networks, known for their powerful, intelligent features and energy-efficiency advantages. These characteristics render them ideally suited for edge computing scenarios. Nevertheless, the current mapping schemes for deploying SNNs onto neuromorphic hardware face limitations such as extended execution times, low throughput, and insufficient consideration of energy consumption and connectivity, which undermine their suitability for edge computing applications. To address these challenges, we introduce EdgeMap, an optimized mapping toolchain specifically designed for deploying SNNs onto edge devices without compromising performance. EdgeMap consists of two main stages. The first stage involves partitioning the SNN graph into small neuron clusters based on the streaming graph partition algorithm, with the sizes of neuron clusters limited by the physical neuron cores. In the subsequent mapping stage, we adopt a multi-objective optimization algorithm specifically geared towards mitigating energy costs and communication costs for efficient deployment. EdgeMap-evaluated across four typical SNN applications-substantially outperforms other state-of-the-art mapping schemes. The performance improvements include a reduction in average latency by up to 19.8%, energy consumption by 57%, and communication cost by 58%. Moreover, EdgeMap exhibits an impressive enhancement in execution time by a factor of 1225.44×, alongside a throughput increase of up to 4.02×. These results highlight EdgeMap's efficiency and effectiveness, emphasizing its utility for deploying SNN applications in edge computing scenarios.
BibTeX
@inproceedings{xue2023edgemap,
  author = {Jianwei Xue and Xie Li-sheng and Faquan Chen and Liangshun Wu and Qingyang Tian and Yifan Zhou and Rendong Ying and Peilin Liu},
  title = {{EdgeMap: An Optimized Mapping Toolchain for Spiking Neural Network in Edge Computing}},
  booktitle = {Sensors},
  year = {2023},
  doi = {10.3390/s23146548},
}
Figure