Federated Learning-Oriented Edge Computing Framework for the IIoT

Xianhui Liu, Xianghu Dong, Ning Jia, Weidong ZhaoSensors 2024 · DOI

TL;DR

This paper introduces a novel three-layer, software-defined edge computing framework specifically designed for the Industrial Internet of Things (IIoT) that integrates federated learning. By employing a time-series-based approach for device selection and computation offloading, it significantly reduces training time and energy consumption compared to traditional random selection methods, making AI deployment in industrial settings more efficient and practical.

What Problem Does This Paper Address?

The Industrial Internet of Things (IIoT) promises to revolutionize manufacturing and other industrial sectors by connecting devices and leveraging data for intelligent decision-making. However, deploying Artificial Intelligence (AI) models in this environment faces several hurdles:

  • Hardware/Software Coupling: Industrial edge devices often have tightly coupled hardware and software, making it difficult to deploy and manage AI models flexibly.
  • Protocol Diversity: A wide range of communication protocols exists in industrial settings, complicating device integration.
  • Deployment Challenges: Getting AI models from the cloud to edge devices and ensuring they run efficiently is complex.
  • Limited Edge Resources: Edge devices have insufficient computing power for complex AI tasks, leading to delays.
  • Sensitivity to Delay and Energy: Many IIoT applications are time-sensitive and operate under strict energy constraints, making efficient AI model training crucial.

Existing solutions often struggle with these issues, particularly when trying to balance performance, privacy, and resource limitations in a distributed IIoT environment.

Methods

The paper proposes a multi-faceted solution:

  1. Software-Defined Three-Layer IIoT Edge Computing Framework:
    • Device Layer: Utilizes container virtualization to decouple hardware and software, supporting diverse access protocols (e.g., MQTT, ModBus, OPC-UA) and enabling rapid deployment. It handles data acquisition, protocol parsing, and local data processing.
  2. Data Layer: Manages digital twins of devices for virtual mapping and state monitoring. It also handles data storage (relational and non-relational databases) and acts as a central registry for microservices.
  3. AI Function Layer: Orchestrates the AI model lifecycle, including deployment, data preprocessing, model training, and inference. It supports rapid development and deployment of AI applications.
  4. AI-Oriented Edge Computing System: Built upon the framework, this system uses a microservice architecture for modularity and scalability. It comprises a protocol service layer, data layer, and application layer, facilitating seamless interaction between devices, data, and AI services.
  5. Time Series-Based Device Selection and Computation Offloading: This is the core innovation for federated learning. Instead of random client selection, it:
  6. Maintains a "time queue" of estimated local model training times for each device.
  7. Selects devices for training based on this time series, aiming for devices with similar training times to improve consistency.
  8. Implements computation offloading: if a device's estimated energy consumption for a task exceeds a threshold, the excess computation is offloaded to the edge computing center. This balances local processing with centralized support for resource-constrained devices.

Datasets

  • MNIST Dataset: Used for training and evaluating the proposed MLP model. The dataset consists of 60,000 training and 10,000 testing images of handwritten digits (28x28 pixels). The training samples were distributed among 40 edge devices, with each device receiving between 1000 and 2000 samples.

Key Insights and Ideas

  • Software-Defined Flexibility is Key: Decoupling hardware and software through containerization is essential for managing the complexity and diversity of IIoT devices and protocols.
  • Federated Learning Needs Smarter Selection: Random client selection in federated learning is inefficient. A time-series-aware approach that considers device performance characteristics can significantly improve training speed and energy efficiency.
  • Computation Offloading as a Balancing Act: Offloading tasks from resource-limited edge devices to a more powerful edge center is a viable strategy, but it needs to be intelligently managed to avoid becoming a bottleneck itself.
  • Holistic Framework for IIoT AI: The paper demonstrates that a well-structured, multi-layered framework is necessary to address the end-to-end challenges of deploying AI in industrial environments, from device connectivity to model training and inference.

Key Results

The experimental results, using an MLP model on the MNIST dataset, show significant improvements:

  • Training Time Reduction: The proposed time series-based method reduced model training time by 30% to 50% compared to random device selection.
  • Energy Consumption Reduction: Training energy consumption was reduced by 35% to 55% compared to random device selection.
  • Model Accuracy and Convergence: The proposed method showed minimal impact on final model accuracy and convergence, with slight differences observed in early training rounds that diminished over time. The smaller the time-weighted inverse coefficient, the greater the impact on early convergence, but not the final outcome.

Limitations and Future Work

  • Container Virtualization Jitter: The authors acknowledge that the container virtualization approach can introduce a small probability of uncertain jitter, which is a challenge for highly real-time industrial applications.
  • Future Work: The authors plan to focus on:
  • Improving the real-time performance of the system.
  • Increasing the efficiency of data transmission.
  • Enhancing the time-sharing scheduling strategy.
  • Optimizing computing resource allocation.

They hope their proposed architecture can serve as a reference for future research in IIoT edge computing for AI.

Summary updated

Abstract

With the maturity of artificial intelligence (AI) technology, applications of AI in edge computing will greatly promote the development of industrial technology. However, the existing studies on the edge computing framework for the Industrial Internet of Things (IIoT) still face several challenges, such as deep hardware and software coupling, diverse protocols, difficult deployment of AI models, insufficient computing capabilities of edge devices, and sensitivity to delay and energy consumption. To solve the above problems, this paper proposes a software-defined AI-oriented three-layer IIoT edge computing framework and presents the design and implementation of an AI-oriented edge computing system, aiming to support device access, enable the acceptance and deployment of AI models from the cloud, and allow the whole process from data acquisition to model training to be completed at the edge. In addition, this paper proposes a time series-based method for device selection and computation offloading in the federated learning process, which selectively offloads the tasks of inefficient nodes to the edge computing center to reduce the training delay and energy consumption. Finally, experiments carried out to verify the feasibility and effectiveness of the proposed method are reported. The model training time with the proposed method is generally 30% to 50% less than that with the random device selection method, and the training energy consumption under the proposed method is generally 35% to 55% less.
BibTeX
@inproceedings{liu2024federated,
  author = {Xianhui Liu and Xianghu Dong and Ning Jia and Weidong Zhao},
  title = {{Federated Learning-Oriented Edge Computing Framework for the IIoT}},
  booktitle = {Sensors},
  year = {2024},
  doi = {10.3390/s24134182},
}
Figure