Communication-Efficient Multi-Modal Edge Inference via Uncertainty-Aware Distributed Learning
Lists
Only you see this
Abstract
Semantic communication is emerging as a key enabler for distributed edge intelligence due to its capability to convey task-relevant meaning. However, achieving communication-efficient training and robust inference over wireless links remains challenging. This challenge is further exacerbated for multi-modal edge inference (MMEI) by two factors: 1) prohibitive communication overhead for distributed learning over bandwidth-limited wireless links, due to the \emph{multi-modal} nature of the system; and 2) limited robustness under varying channels and noisy multi-modal inputs. In this paper, we propose a three-stage communication-aware distributed learning framework to improve training and inference efficiency while maintaining robustness over wireless channels. In Stage~I, devices perform local multi-modal self-supervised learning to obtain shared and modality-specific encoders without device--server exchange, thereby reducing the communication cost. In Stage~II, distributed fine-tuning with centralized evidential fusion calibrates per-modality uncertainty and reliably aggregates features distorted by noise or channel fading. In Stage~III, an uncertainty-guided feedback mechanism selectively requests additional features for uncertain samples, optimizing the communication--accuracy tradeoff in the distributed setting. Experiments on RGB--depth indoor scene classification show that the proposed framework attains higher accuracy with far fewer training communication rounds and remains robust to modality degradation or channel variation, outperforming existing self-supervised and fully supervised baselines.
BibTeX
@misc{zhao2026communication,
author = {Hang Zhao and Hongru Li and Dongfang Xu and Shenghui Song and Khaled B. Letaief},
title = {{Communication-Efficient Multi-Modal Edge Inference via Uncertainty-Aware Distributed Learning}},
year = {2026},
eprint = {2601.14942},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2601.14942},
}Loading related content...