MINT: Multiplier-less Integer Quantization for Spiking Neural Networks

Ruokai Yin, Yuhang Li, Abhishek Moitra, Priyadarshini Panda

Abstract

We propose Multiplier-less INTeger (MINT) quantization, a uniform quantization scheme that efficiently compresses weights and membrane potentials in spiking neural networks (SNNs). Unlike previous SNN quantization methods, MINT quantizes memory-intensive membrane potentials to an extremely low precision (2-bit), significantly reducing the memory footprint. MINT also shares the quantization scaling factor between weights and membrane potentials, eliminating the need for multipliers required in conventional uniform quantization. Experimental results show that our method matches the accuracy of full-precision models and other state-of-the-art SNN quantization techniques while surpassing them in memory footprint reduction and hardware cost efficiency at deployment. For example, 2-bit MINT VGG-16 achieves 90.6% accuracy on CIFAR-10, with roughly 93.8% reduction in memory footprint from the full-precision model and 90% reduction in computation energy compared to vanilla uniform quantization at deployment.

Introduction

Spiking Neural Networks (SNNs) are often touted as the "green" alternative to traditional Artificial Neural Networks (ANNs) because they process information using sparse, binary spikes. However, two major hurdles prevent them from being truly efficient on edge hardware:

  1. The Membrane Potential Bottleneck: While many researchers focus on compressing model weights, they often ignore the "membrane potential" ($u$)—the internal state each neuron must store to track temporal data. As weight precision drops, these potentials start to dominate the memory footprint, accounting for up to 98% of total memory in mini-batch processing.
  2. The Scaling Factor Tax: Standard "Uniform Quantization" (UQ) requires multiplying quantized values by a high-precision (32-bit) scaling factor to maintain accuracy. In hardware accelerators like SpinalFlow, these scaling units can consume nearly half (46.3%) of the total system area, effectively negating the benefits of low-precision arithmetic.
Figure 1: Analysis of memory footprint and hardware area bottlenecks in SNNs.

The MINT Approach

The authors introduce MINT, which rethinks the fundamental Leaky-Integrate-and-Fire (LIF) neuron equations to remove hardware complexity. The core innovation lies in a unified low-precision scheme and mathematical rearrangement:

  • Unified Low Precision: MINT quantizes both weights ($w$) and membrane potentials ($u$) to the same extremely low bit-width (e.g., 2-bit or 4-bit).
  • Scaling Factor Sharing: By forcing the scaling factors for weights and potentials to be identical ($\alpha_w = \alpha_u = \alpha$), the authors mathematically transform the LIF update equation. During inference, the scaling factor $\alpha$ cancels out of the "update" stage and is absorbed into a pre-computed integer firing threshold ($\theta$).
  • Multiplier-less Inference: Because the scaling factor is handled offline, the hardware only needs to perform integer additions and bit-shifts (for leakage). The complex 32-bit multipliers usually required for scaling are completely removed from the datapath.
  • Learnable Quantization: To prevent accuracy loss at 2-bit precision, the scaling factor $\alpha$ is treated as a learnable parameter during training, allowing the network to adapt its dynamic range to the quantization constraints.

Experimental Evaluation

The researchers evaluated MINT across a variety of architectures (VGG-9, VGG-16, ResNet-19) using static image datasets (CIFAR-10, TinyImageNet) and neuromorphic datasets (CIFAR-10 DVS).

Key Results

  • High Accuracy at Low Bits: A 2-bit MINT VGG-16 model achieved 90.6% accuracy on CIFAR-10, representing only a 0.6% drop from the full-precision (32-bit) version.
  • Massive Memory Savings: MINT achieved a 93.8% reduction in total memory footprint compared to full-precision models. This is largely due to the successful quantization of membrane potentials, which otherwise dominate memory as weight precision decreases.
  • Superior Energy Efficiency: Compared to "vanilla" uniform quantization, MINT reduced computation energy by 90% because it removed the need for 32-bit scaling multiplications.
  • Hardware Area Reduction: When implemented on a systolic array accelerator, MINT reduced the Processing Element (PE) area by roughly 85% compared to standard quantization methods.
Figure 5: Normalized PE Area comparison showing MINT's significant area reduction across various bit-widths.

Discussion and Future Work

MINT demonstrates that membrane potential is the real memory hog in SNN deployment and that high-precision multipliers are often overkill for applying scaling factors. Interestingly, in some cases (like VGG-16 on TinyImageNet), the 8-bit MINT model actually outperformed the full-precision baseline, suggesting that ultra-low precision can act as a form of regularization.

Future work could explore "mixed-precision" MINT, where sensitive layers keep higher precision while others drop to 1-bit to further optimize the energy-accuracy tradeoff. Additionally, while results on TinyImageNet are promising, testing MINT on industry-standard benchmarks like ImageNet-1K would further validate its robustness for large-scale applications.

Summary updated

Abstract

We propose Multiplier-less INTeger (MINT) quantization, a uniform quantization scheme that efficiently compresses weights and membrane potentials in spiking neural networks (SNNs). Unlike previous SNN quantization methods, MINT quantizes memory-intensive membrane potentials to an extremely low precision (2-bit), significantly reducing the memory footprint. MINT also shares the quantization scaling factor between weights and membrane potentials, eliminating the need for multipliers required in conventional uniform quantization. Experimental results show that our method matches the accuracy of full-precision models and other state-of-the-art SNN quantization techniques while surpassing them in memory footprint reduction and hardware cost efficiency at deployment. For example, 2-bit MINT VGG-16 achieves 90.6% accuracy on CIFAR-10, with roughly 93.8% reduction in memory footprint from the full-precision model and 90% reduction in computation energy compared to vanilla uniform quantization at deployment. The code is available at https://github.com/Intelligent-Computing-Lab-Yale/MINT-Quantization.
BibTeX
@inproceedings{yin2024mint,
  author = {Ruokai Yin and Yuhang Li and Abhishek Moitra and Priyadarshini Panda},
  title = {{MINT: Multiplier-less Integer Quantization for Spiking Neural Networks}},
  booktitle = {ASPDAC},
  year = {2024},
  doi = {10.1109/asp-dac58780.2024.10473825},
}
Figure