Lead federated neuromorphic learning for wireless edge artificial intelligence

Helin Yang, Kwok-Yan Lam, Liang Xiao, Zehui Xiong, Hao Hu, Dusit Niyato, H. Vincent PoorNature Communications 2022 · OpenReview

Abstract

Realizing the potential of wireless edge artificial intelligence (AI) requires training complex models on resource-constrained devices using diverse datasets. This paper introduces Lead Federated Neuromorphic Learning (LFNL), a decentralized, energy-efficient framework based on Spiking Neural Networks (SNNs). LFNL allows edge devices to collaboratively train global models using a brain-inspired architecture while preserving privacy. Experimental results demonstrate that LFNL achieves comparable accuracy to standard edge AI while reducing data traffic by >3.5×, computational latency by >2.0×, and energy consumption by >4.5×.

Introduction

Edge AI faces significant hurdles: individual devices often lack sufficient local data (data scarcity), and their limited battery life and processing power make training standard Artificial Neural Networks (ANNs) difficult. While Federated Learning (FL) addresses data scarcity by sharing model updates, it typically relies on a central server and energy-intensive ANNs. LFNL addresses these challenges by combining neuromorphic computing with a decentralized leader-follower architecture.

The conceptual framework of human brain-inspired collaborative learning, showing the transition from sensory input to spike encoding and group aggregation.

Methodology

LFNL integrates two core innovations to optimize edge computing:

Neuromorphic Computing with SNNs

Unlike traditional ANNs that use continuous values, SNNs process information via discrete temporal "spikes." This sparse computing model mimics biological neurons, replacing power-hungry multiplications with simple additions. This allows for "sparse" computing—if there is no spike, there is no computation—leading to significant energy savings. To overcome the non-differentiable nature of spikes, a pseudo-gradient method is used for backpropagation training.

Lead Federated Learning

To eliminate the need for a fixed central server, LFNL employs a leader election scheme. A device with superior resources (e.g., higher battery or signal strength) is elected as the "leader" to aggregate model weights from "follower" peers. This decentralized approach avoids single points of failure and reduces communication bottlenecks often found in fully peer-to-peer mesh networks.

Overview of LFNL: (c) SNN architecture for multi-modal recognition, (d) leader-follower communication, (e) edge application in a traffic scenario, and (f) federated weight aggregation logic.

Experimental Results

The framework was evaluated across several modalities, including audio (traffic sounds), visual (traffic images), and radar (gesture recognition), as well as standard benchmarks like CIFAR-10/100.

  • Energy and Communication Efficiency: LFNL reduced energy consumption by over 4.5× and data traffic by over 3.5× compared to standard FL.
  • Computational Speed: Processing latency was halved, achieving a >2.0× reduction.
  • Accuracy and Robustness: Accuracy remained high (e.g., 95.6% for visual tasks), with only a marginal 1.5% loss compared to centralized ANN training. Crucially, the system proved stable in "Non-IID" scenarios, where data distribution across devices is highly uneven.

Conclusion

LFNL provides a scalable, ultra-low-power solution for decentralized edge AI. By leveraging the sparsity of spiking neural networks and a flexible leader-follower architecture, it overcomes the primary energy and communication barriers of wireless edge computing. Future work will focus on narrowing the accuracy gap and improving leader resilience in dynamic environments where devices may frequently move out of range.

Summary updated

Abstract

In order to realize the full potential of wireless edge artificial intelligence (AI), very large and diverse datasets will often be required for energy-demanding model training on resource-constrained edge devices. This paper proposes a lead federated neuromorphic learning (LFNL) technique, which is a decentralized energy-efficient brain-inspired computing method based on spiking neural networks. The proposed technique will enable edge devices to exploit brain-like biophysiological structure to collaboratively train a global model while helping preserve privacy. Experimental results show that, under the situation of uneven dataset distribution among edge devices, LFNL achieves a comparable recognition accuracy to existing edge AI techniques, while substantially reducing data traffic by >3.5× and computational latency by >2.0×. Furthermore, LFNL significantly reduces energy consumption by >4.5× compared to standard federated learning with a slight accuracy loss up to 1.5%. Therefore, the proposed LFNL can facilitate the development of brain-inspired computing and edge AI. Designing energy-efficient computing solution for the implementation of AI algorithms in edge devices remains a challenge. Yang et al. proposes a decentralized brain-inspired computing method enabling multiple edge devices to collaboratively train a global model without a fixed central coordinator.
BibTeX
@inproceedings{yang2022lead,
  author = {Helin Yang and Kwok-Yan Lam and Liang Xiao and Zehui Xiong and Hao Hu and Dusit Niyato and H. Vincent Poor},
  title = {{Lead federated neuromorphic learning for wireless edge artificial intelligence}},
  booktitle = {Nature Communications},
  year = {2022},
  url = {https://openreview.net/forum?id=VydBDhx8cR},
}
Figure