Introducing Edge Intelligence to Smart Meters via Federated Split Learning

Yi Wang, Yehui Li, Dalin Qin, H. Vincent Poor

TL;DR

This paper introduces a novel end-edge-cloud federated split learning framework that brings advanced AI to resource-constrained smart meters. By strategically splitting neural networks and utilizing a semi-asynchronous training approach, the researchers achieved a 95.5% reduction in memory footprint and a 94.8% reduction in training time, allowing meters with just 192KB of RAM to perform high-accuracy load forecasting without compromising data privacy.

What Problem Does This Paper Address?

Smart meters are the backbone of the modern power grid, yet they are surprisingly "dumb." While they collect massive amounts of fine-grained energy consumption data, they typically act as simple pass-through devices, sending raw data to central servers for analysis.

This creates three major bottlenecks:

  1. Privacy: Sending raw energy data to the cloud exposes sensitive consumer habits.
  2. Bandwidth: Transmitting high-resolution data from billions of meters creates massive network congestion.
  3. Hardware Constraints: Standard deep learning models are far too large for the typical smart meter, which often runs on microcontrollers (like the ARM Cortex-M4) with less than 200KB of SRAM.

Existing solutions like Federated Learning (FL) still require the device to train a full model, while standard Split Learning (SL) can be slow and communication-heavy. The authors aim to bridge this gap by creating a "best of both worlds" framework.

Methods

The authors propose an end-edge-cloud federated split learning architecture. The core innovation lies in three specific techniques:

  • Efficiency-Optimal Model Splitting: Instead of a random cut, the cloud server uses a mathematical optimization to determine the best "split ratio" ($\alpha$). This ensures the portion of the model residing on the smart meter fits within its tiny 192KB SRAM while minimizing overall training time. The model is split into three parts: a feature extractor (on the meter), a feature processor (on the edge server), and a regressor (back on the meter to protect the final output).
  • Collaborative Training with Parallelism & Knowledge Distillation: Traditionally, split learning is sequential (the meter waits for the edge). The authors added a tiny auxiliary regressor to the meter. This allows the meter and the edge server to train their respective parts in parallel. To ensure these two "halves" stay synchronized, they use Knowledge Distillation (KD), where the main model's insights guide the auxiliary model's learning.
  • Semi-Asynchronous Model Aggregation: To handle "stragglers" (slow meters), the system uses a two-stage approach. Meters with similar hardware speeds are clustered and updated synchronously at the edge, while the edge-to-cloud updates happen asynchronously.

Datasets

The framework was validated using two prominent open-source smart meter datasets:

  1. BDG2 (Building Data Genome 2): Contains hourly-resolution load profiles for various building types across North America and Europe (2016–2017).
  2. CBTs (Commission for Energy Regulation): Contains half-hourly load data from Irish residents (2009–2010).

The researchers used data from 30 randomly selected buildings/residences for their hardware-in-the-loop simulation.

Key Insights and Ideas

  • Parallelizing the "Un-parallelizable": Split learning is inherently sequential. By introducing a "sidecar" auxiliary network on the meter, the authors turned a serial process into a parallel one, drastically cutting idle time for the hardware.
  • The Power of the "Split": By keeping the input (feature extractor) and the output (regressor) on the meter, the system achieves "privacy by design." The edge server only ever sees "smashed data"—abstract mathematical representations that are useless to a hacker without the rest of the model.
  • Hardware-Aware Clustering: The insight that "device heterogeneity" (some meters being slower than others) can be solved by grouping devices by their computational speed rather than their data distribution is a clever way to stabilize federated training.

Key Results

The proposed method was tested on a real hardware platform (ARM Cortex-M4 MCUs) and compared against standard centralized and federated methods:

  • Memory Efficiency: Reduced the peak memory footprint by 95.5% compared to centralized models.
  • Speed: Achieved a 19.23x speedup in training time compared to standard local training on the MCU.
  • Communication: Reduced the communication burden by 50% compared to traditional distributed learning frameworks.
  • Accuracy: Despite the massive resource savings, the model achieved forecasting accuracy (measured by 1-MAPE) comparable to, and sometimes better than, "resource-unlimited" centralized models. It outperformed standard FedAvg and Split Learning benchmarks in almost every scenario.

Limitations and Future Work

While the results are impressive, the authors note several areas for further exploration:

  • Unstable Communications: The current model assumes relatively stable connections; real-world "noisy" or intermittent networks might require more robust device selection algorithms.
  • Data Heterogeneity: While the model performs well on average, highly unique energy usage patterns (extreme outliers) might still require "personalization" techniques where the global model is further fine-tuned for individual homes.
  • Online Renewal: The paper focuses on initial training; developing a seamless way to update these models "on the fly" as consumer behavior changes over years is the next logical step.

Summary updated

Abstract

<title>Abstract</title> The ubiquitous smart meters are expected to be a central feature of future smart grids by enabling the collection of massive fine-grained consumption data to support demand-side flexibility. However, the current smart meters are still not smart enough. They can only perform basic data collection and communication functionalities but fail to carry out any on-device intelligent data analytics due to hardware constraints in terms of memory, computation, and communication capacity. Moreover, privacy concerns have hindered the utilization of data from distributed smart meters. Here, we present an end-edge-cloud federated split learning framework to enable collaborative model training on resource-constrained smart meters with the assistance of edge and cloud servers in a resource-efficient and privacy-enhancing manner. The proposed method is validated on a hardware platform to conduct building and household load forecasting on smart meters with only 192KB of static random-access memory (SRAM). We show that the proposed method can reduce the memory footprint by 95.5%, the training time by 94.8%, and the communication burden by 50% under the distributed learning framework, and achieve comparable or even superior forecasting accuracy compared to resource-unlimited methods.
BibTeX
@inproceedings{wang2024introducing,
  author = {Yi Wang and Yehui Li and Dalin Qin and H. Vincent Poor},
  title = {{Introducing Edge Intelligence to Smart Meters via Federated Split Learning}},
  booktitle = {Nature Communications},
  year = {2024},
  doi = {10.1038/s41467-024-53352-9},
}
Figure