Load-Balance-Guaranteed DNN Distributed Inference Offloading in MEC Networks Interconnected by Metro Optical Networks
Lists
Only you see this
Abstract
In multi-access edge computing (MEC) networks interconnected by metro optical networks, distributed inference is a promising technique to guarantee user experience for deep neural network (DNN) inference tasks while balancing the load of edge servers. It can partition an entire DNN model into multiple sequentially connected DNN blocks and offload them to distributed edge servers for processing. However, since the number and location of partitioning points are uncertain, the inference delay may be unacceptable due to long transmission delay if DNN inference tasks are divided into too many DNN blocks. Moreover, the computing capacity of edge servers is limited. The inference delay may also be unacceptable due to inadequate computing resources if target edge servers for DNN blocks are heavily loaded or overloaded. In order to accept more DNN inference tasks using limited computing resources, this paper proposes a load-balance-guaranteed DNN distributed inference offloading (LBG-DDIO) scheme to achieve flexible partitioning and offloading, where the partitioning and offloading decisions are determined by jointly considering the inference delay and the imbalanced degree of load (IDL). An efficient heuristic algorithm is developed to determine each DNN block according to the corresponding finish time and IDL, and the selection of target edge servers for DNN blocks is also optimized. LBG-DDIO is compared with four benchmarks, and the simulation results prove that LBG-DDIO can achieve a high acceptance ratio while keeping the load balanced.
BibTeX
@article{xin2025load,
author = {Jingjie Xin and Xin Li and Daniel C. Kilper and Shanguo Huang},
title = {{Load-Balance-Guaranteed DNN Distributed Inference Offloading in MEC Networks Interconnected by Metro Optical Networks}},
journal = {IEEE Transactions on Network Science and Engineering},
year = {2025},
doi = {10.1109/tnse.2025.3637030},
}Loading related content...