SpikeSim: An End-to-End Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks

Abhishek Moitra, Abhiroop Bhattacharjee, Runcong Kuang, Gokul Krishnan, Yu Cao, Priyadarshini Panda

TL;DR

SpikeSim is the first end-to-end evaluation tool designed to benchmark Spiking Neural Networks (SNNs) on In-Memory Computing (IMC) hardware. It bridges the gap between high-level algorithm design and physical hardware constraints, revealing that while SNNs offer massive energy efficiency, the "memory tax" of storing neuronal states is a significant bottleneck that requires hardware-aware architectural co-design.

What Problem Does This Paper Address?

Spiking Neural Networks (SNNs) are hailed as the energy-efficient future of AI because they process data using sparse, brain-like "spikes" over time. However, running them on traditional von-Neumann hardware (where memory and processors are separate) leads to a "memory wall" bottleneck.

In-Memory Computing (IMC) using analog crossbars—where computation happens directly within memory cells—is a promising solution. But there’s a catch: existing IMC simulators are built for standard Artificial Neural Networks (ANNs). They ignore SNN-specific requirements like temporal processing and Leaky-Integrate-Fire (LIF) neurons. Crucially, they fail to model how analog hardware "noise" (non-idealities like parasitic resistance) accumulates over multiple time-steps, which can tank an SNN's accuracy.

Methods

The authors introduce SpikeSim, which consists of three main components:

  1. SpikeFlow Mapping: A monolithic IMC architecture that maps SNNs onto tiled crossbars. It features a novel, fully digital DIFF module that handles signed operations (positive and negative weights) without needing the area-heavy "dual-crossbar" approach used in most ANN accelerators.
  2. NICE (Non-Ideality Computation Engine): This engine performs circuit-level analysis to model resistive parasitics and device variations. It introduces NI-aware weight encoding, a technique that mathematically shifts weights to maximize the number of high-resistance states (logical 0s) in the crossbar, significantly improving robustness against hardware noise.
  3. ELA (Energy-Latency-Area) Engine: A Python-based tool that tracks the physical costs of the SNN implementation, including the overhead of the Network-on-Chip (NoC) and neuronal storage.

Datasets

The tool was evaluated using standard computer vision benchmarks:

  • CIFAR-10
  • CIFAR-100
  • TinyImageNet (a more complex dataset with 200 classes)

The models used were VGG-style architectures (VGG5, VGG9, and VGG16) trained using Back-Propagation Through Time (BPTT).

Key Insights and Ideas

  • The Neuronal Area Bottleneck: The authors discovered that the neuronal module (LIF/IF) is a massive area hog, consuming 11–30% of the total chip area. This is because SNNs must store "membrane potentials" (the internal state of every neuron) across multiple time-steps.
  • The "First Layer" Lever: The first convolutional layer often contributes the most to the Energy-Delay Product (EDP). By simply reducing the number of output channels in the first layer, the authors achieved a 10× reduction in EDP with minimal impact on accuracy.
  • Noise Accumulation: Unlike ANNs, where a calculation happens once, SNNs perform repeated analog operations over time. SpikeSim shows that without "NI-aware" encoding, accuracy can drop to near-random levels (~10%) due to error accumulation.
  • SNN vs. ANN: At low time-steps ($T=3$ to $5$), SNNs on IMC hardware can achieve better energy efficiency and throughput than 4-bit quantized ANNs, despite having much larger neuronal modules.

Key Results

  • Accuracy Recovery: The NI-aware weight encoding improved the accuracy of crossbar-mapped SNNs by more than 70% for CIFAR-10 compared to vanilla encoding.
  • Area Efficiency: Topological modifications (like channel scaling) reduced the neuronal module area by 1.24×.
  • Hardware Comparison: SNNs exhibit roughly 1000× higher neuronal module area compared to ANNs (due to the membrane potential cache) but remain competitive in overall energy-delay performance when time-steps are kept low.
  • Implementation: The evaluation was based on a 65nm CMOS process with both SRAM and RRAM (resistive RAM) device models.

Limitations and Future Work

The primary limitation identified is the trade-off between time-steps and accuracy. While SNNs are most efficient at very low time-steps ($T < 5$), training them to maintain high accuracy on complex datasets like TinyImageNet at these levels remains a challenge.

The authors suggest that future research should focus on IMC-aware SNN training algorithms that specifically optimize for low-latency spikes and hardware-specific dataflows to further mitigate the neuronal area overhead.

Summary updated

Abstract

SNNs are an active research domain towards energy efficient machine intelligence. Compared to conventional ANNs, SNNs use temporal spike data and bio-plausible neuronal activation functions such as Leaky-Integrate Fire/Integrate Fire (LIF/IF) for data processing. However, SNNs incur significant dot-product operations causing high memory and computation overhead in standard von-Neumann computing platforms. Today, In-Memory Computing (IMC) architectures have been proposed to alleviate the "memory-wall bottleneck" prevalent in von-Neumann architectures. Although recent works have proposed IMC-based SNN hardware accelerators, the following have been overlooked- 1) the adverse effects of crossbar non-ideality on SNN performance due to repeated analog dot-product operations over multiple time-steps, 2) hardware overheads of essential SNN-specific components such as the LIF/IF and data communication modules. To this end, we propose SpikeSim, a tool that can perform realistic performance, energy, latency and area evaluation of IMC-mapped SNNs. SpikeSim consists of a practical monolithic IMC architecture called SpikeFlow for mapping SNNs. Additionally, the non-ideality computation engine (NICE) and energy-latency-area (ELA) engine performs hardware-realistic evaluation of SpikeFlow-mapped SNNs. Based on 65nm CMOS implementation and experiments on CIFAR10, CIFAR100 and TinyImagenet datasets, we find that the LIF/IF neuronal module has significant area contribution (>11% of the total hardware area). We propose SNN topological modifications leading to 1.24x and 10x reduction in the neuronal module's area and the overall energy-delay-product value, respectively. Furthermore, in this work, we perform a holistic comparison between IMC implemented ANN and SNNs and conclude that lower number of time-steps are the key to achieve higher throughput and energy-efficiency for SNNs compared to 4-bit ANNs.
BibTeX
@article{moitra2023spikesim,
  author = {Abhishek Moitra and Abhiroop Bhattacharjee and Runcong Kuang and Gokul Krishnan and Yu Cao and Priyadarshini Panda},
  title = {{SpikeSim: An End-to-End Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks}},
  journal = {IEEE Trans. Comput. Aided Des. Integr. Circuits Syst.},
  year = {2023},
  doi = {10.1109/tcad.2023.3274918},
}

Loading related content...

Figure