Multivariate Time Series Classification Using Spiking Neural Networks

Haowen Fang, Amar Shrestha, Qinru Qiu

TL;DR

This paper introduces a novel framework for classifying multivariate time series (MTS) using Spiking Neural Networks (SNNs). By combining a spatial-temporal population encoding scheme with an iterative training algorithm, the authors achieve classification accuracy comparable to state-of-the-art deep learning models while significantly reducing computational overhead and model size.

What Problem Does This Paper Address?

As the Internet of Things (IoT) and Cyber-Physical Systems (CPS) expand, there is a massive demand for processing temporal sensor data on energy-constrained embedded devices. Spiking Neural Networks (SNNs) are a promising solution because they mimic the brain's energy efficiency, processing information via sparse "spikes" rather than continuous values.

However, SNNs face three major hurdles in time series tasks:

  1. Encoding Inefficiency: Most SNNs use "rate coding" (representing values by the number of spikes in a window), which ignores the precise timing of spikes and is poorly suited for the varying scales and precisions of multivariate sensor data.
  2. Training Difficulties: The output of a spiking neuron is a non-differentiable step function, making standard backpropagation (the engine of modern AI) impossible to apply directly.
  3. Temporal Credit Assignment: Existing SNN models often struggle to learn long-term dependencies across time steps in a way that is computationally efficient.

Methods

The authors propose a three-part solution:

  • Spatial-Temporal Population Encoding: Instead of simple rate coding, they use a population of "Current-based Integrate and Fire" (CUBA) neurons to encode each signal. Each neuron in the population has different parameters (gain and time constants), allowing the group to capture complex temporal patterns and handle negative values or varying signal ranges with very few spikes.
  • Iterative SNN Model: They derive a discrete-time, iterative version of the Spike Response Model (SRM). This formulation allows the SNN to be "unrolled" in time, similar to a Recurrent Neural Network (RNN), making it compatible with Backpropagation Through Time (BPTT).
  • Gradient Surrogates: To solve the non-differentiability problem, they use a smooth sigmoid function as a "surrogate" for the spike function during the backward pass of training. This allows gradients to flow through the network while keeping the forward pass purely spike-based.
  • Event-Driven Inference: They provide an algorithm that only performs computations when a spike actually occurs. This exploits the sparsity of the signal to save power during deployment.

Datasets

The approach was evaluated using multiple multivariate time series datasets from the UCR/UEA repository, including:

  • Articulary Word Recognition
  • FaceDetection
  • BasicMotions
  • Heartbeat
  • Spoken Arabic Digits
  • JapaneseVowels
  • RacketSports
  • Atrial Fibrillation (used specifically for efficiency testing)

Key Insights and Ideas

  • Timing is Everything: The "aha moment" here is that the structure and timing of spikes carry more information than the mere count. By focusing on temporal patterns, the authors represent data more densely and accurately than traditional SNNs.
  • Efficiency through Sparsity: The proposed encoding is incredibly sparse. For the Articulary Word Recognition dataset, the method reduced the input from 1,296 spike trains (required by rate coding) to just 45, without losing accuracy.
  • Smaller is Better: Because the encoding is so efficient, the resulting SNN requires far fewer parameters than traditional deep learning models to achieve the same result.

Key Results

  • Comparable Accuracy: The SNN achieved an accuracy of 98.27% on the Articulary Word Recognition task, nearly identical to a much larger LSTM (98.31%) and RNN (98.20%).
  • Massive Parameter Reduction: The SNN model used only 125,880 parameters, which is roughly 11% of the parameters required by a comparable LSTM (1.1 million parameters).
  • Lower Computational Load: On the Atrial Fibrillation dataset, the proposed temporal encoding resulted in a spike count of 164.5 compared to over 23,000 for rate coding—a massive reduction in the number of operations required for inference.

Limitations and Future Work

While the results are impressive, the authors note a few areas for growth:

  • Hardware Realization: While the algorithm is designed for neuromorphic hardware (which thrives on event-driven computation), the tests were performed on standard GPUs using PyTorch. Real-world energy savings would be most apparent on specialized spiking hardware.
  • Surrogate Choice: The choice of surrogate gradient (sigmoid) is effective but remains an approximation. Exploring more biologically plausible local learning rules that don't require global backpropagation is a common goal in the SNN community.
  • Scaling: Future work could involve testing this framework on even larger-scale multivariate datasets to see if the efficiency gains hold as complexity increases.

Summary updated

Abstract

There is an increasing demand to process streams of temporal data in energy-limited scenarios such as embedded devices, driven by the advancement and expansion of Internet of Things (IoT) and Cyber-Physical Systems (CPS). Spiking neural network has drawn attention as it enables low power consumption by encoding and processing information as sparse spike events, which can be exploited for event-driven computation. Recent works also show SNNs' capability to process spatial temporal information. Such advantages can be exploited by power-limited devices to process real-time sensor data. However, most existing SNN training algorithms focus on vision tasks and temporal credit assignment is not addressed. Furthermore, widely adopted rate encoding ignores temporal information, hence it's not suitable for representing time series. In this work, we present an encoding scheme to convert time series into sparse spatial temporal spike patterns. A training algorithm to classify spatial temporal patterns is also proposed. Proposed approach is evaluated on multiple time series datasets in the UCR repository and achieved performance comparable to deep neural networks.
BibTeX
@inproceedings{fang2020multivariate,
  author = {Haowen Fang and Amar Shrestha and Qinru Qiu},
  title = {{Multivariate Time Series Classification Using Spiking Neural Networks}},
  booktitle = {IJCNN},
  year = {2020},
  url = {https://openreview.net/forum?id=192jguaWt1},
}

Loading related content...

Figure