Training with Integer-only Arithmetic: Energy-efficient Federated Learning with Mobile DSP Offloading

Jinliang Yuan, Daliang Xu, Mengwei Xu, Yuanchun Li, Xuanzhe Liu, Yunhao Liu, Shangguang WangIEEE Trans. Mobile Computing 2025 · DOI

Abstract

AI is making mobile applications increasingly cooler, but also introduces serious privacy risks due to the extensive user data collection. Federated learning (FL), as a privacy-preserving machine learning paradigm, enables mobile devices to collaboratively learn a shared prediction model while keeping all training data on devices. However, a key obstacle towards practical cross-device FL training is the huge energy consumption, especially for lightweight mobile devices. Prior literature mostly optimizes the convergence speed and network communication cost. In this work, we first perform the experimental analysis of improving FL performance through low-precision training with energy-friendly Digital Signal Processor (DSP) on mobile devices. Then, we demonstrate that directly integrating the state-of-the-art INT8 (8-bit integer) training algorithm and classic FL protocols will significantly degrade the model accuracy. Finally, we propose a novel FL protocol, namely <monospace xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Q-FedUpdate</monospace>, incorporates two critical techniques: error-compensated aggregation and pipelined batch quantization. The former can ensure the tiny model updates be accumulated and take effects, and the latter can improve the DSP cache hit rate to reduce the context switching. Extensive experiments show that, <monospace xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Q-FedUpdate</monospace> can effectively reduce the on-device energy consumption by 21×, and accelerate the FL convergence by 6.1× with only 2% accuracy loss.
BibTeX
@article{yuan2025training,
  author = {Jinliang Yuan and Daliang Xu and Mengwei Xu and Yuanchun Li and Xuanzhe Liu and Yunhao Liu and Shangguang Wang},
  title = {{Training with Integer-only Arithmetic: Energy-efficient Federated Learning with Mobile DSP Offloading}},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2025},
  doi = {10.1109/tmc.2025.3635268},
}

Loading related content...

Figure