Spiking networks for improved cognitive abilities of edge computing devices

Anton Akusok, Kaj-Mikael Björk, Leonardo Espinosa Leal, Yoan Miche, Renjie Hu, Amaury Lendasse

TL;DR

This concept paper proposes moving machine learning training from the cloud directly onto edge devices like smartphones using Spiking Neural Networks (SNNs). By leveraging the Liquid State Machine framework, the authors argue we can achieve low-latency, energy-efficient, and privacy-preserving "on-device" learning that traditional deep learning methods currently struggle to provide.

What Problem Does This Paper Address?

Currently, most AI "intelligence" lives in the cloud. While our phones are powerful, they usually just send data to a server, wait for a response, and show the result. This "Cloud-first" approach has three major flaws:

  1. Privacy: Personal data (facial recognition, health metrics) is risky to transmit and store on third-party servers.
  2. Latency: Real-time applications like Augmented Reality (AR) or instant user interaction can’t afford the round-trip delay to a data center.
  3. Connectivity: If you lose your internet connection, the "smart" features of the device often vanish.

While modern mobile hardware now includes dedicated "math accelerators" (like Apple’s Neural Engine or Google’s TPU), the software side is lagging. Traditional Deep Learning training is too slow and power-hungry for a battery-operated device. Furthermore, the standard data science toolkit (Python, R, and global file access) doesn't play well with the restrictive, sandboxed environments of mobile operating systems.

Methods

The authors propose using Spiking Neural Networks (SNNs) implemented within a Liquid State Machine (LSM) framework.

Unlike traditional neural networks that use continuous numbers, SNNs communicate via discrete "spikes" (binary signals), mimicking biological neurons. This allows for extremely high energy efficiency because computations can be performed at very low precision.

The key technical strategy here is Reservoir Computing:

  • The Reservoir: A pool of spiking neurons is created with randomly assigned and fixed internal connections. This "reservoir" is never trained; it simply reacts to input data, creating a complex, time-dependent internal state.
  • The Readout: Only the final output layer ($W_{out}$) is trained. Because the reservoir is fixed, training the output layer becomes a simple linear problem.

This approach combines the representational power of a recurrent neural network with the training speed of a simple linear model, making it computationally "cheap" enough to run on a phone's GPU.

Datasets

Not discussed in the paper. As this is a concept paper focusing on the theoretical framework and hardware-software synergy, the authors do not present results from specific benchmarking datasets (like MNIST or ImageNet).

Key Insights and Ideas

  • The Hardware is Already Here: The authors note that mobile phones are the first devices to receive dedicated math accelerators at a pervasive scale. Mobile GPUs are now performing on par with 45W laptop processors (like the Intel i7) when using optimized libraries.
  • Software is the Bottleneck: The primary hurdle isn't raw power; it's the fact that mobile OS kernels sandbox applications, making traditional command-line-based AI tools difficult to use.
  • Time as a First-Class Citizen: SNNs inherently handle the concept of time due to their internal state. This makes them naturally suited for "human-centric" data, which is almost always a temporal stream (speech, movement, video).
  • Binary Efficiency: Because spikes are binary, the most demanding part of the math (sparse matrix-vector multiplication) can be done with minimal energy, which is the "holy grail" for edge computing.

Key Results

Because this is a concept paper, the "results" are primarily architectural observations rather than experimental tables:

  • Performance Parity: The authors’ work with GPU-accelerated mobile libraries (BLAS/LAPACK) demonstrated that mobile devices can match the performance of high-level CUDA primitives used on desktop workstations.
  • Training Feasibility: By reducing the training phase to a linear problem (via the LSM framework), the authors show that re-training a model on-device is mathematically feasible without the massive power drain of backpropagation.

Limitations and Future Work

The authors acknowledge a significant hurdle: Spiking neurons are not differentiable. This means you cannot use standard gradient-based optimization (like backpropagation) to train the whole network. While the Liquid State Machine bypasses this by only training the output layer, this "fixed reservoir" approach may not yet match the peak accuracy of fully-trained Deep Learning models for every task.

Future work would involve moving from this conceptual framework to large-scale implementations, specifically optimizing the "readout" layer training to handle increasingly complex real-world personal data.

Summary updated

Abstract

This concept paper highlights a recently opened opportunity for large scale analytical algorithms to be trained directly on edge devices. Such approach is a response to the arising need of processing data generated by natural person (a human being), also known as personal data. Spiking Neural networks are the core method behind it: suitable for a low latency energy-constrained hardware, enabling local training or re-training, while not taking advantage of scalability available in the Cloud.
BibTeX
@inproceedings{akusok2019spiking,
  author = {Anton Akusok and Kaj-Mikael Björk and Leonardo Espinosa Leal and Yoan Miche and Renjie Hu and Amaury Lendasse},
  title = {{Spiking networks for improved cognitive abilities of edge computing devices}},
  booktitle = {Petra},
  year = {2019},
  doi = {10.1145/3316782.3321546},
}

Loading related content...

Figure