Goal-Oriented Communications Based on Recursive Early Exit Neural Networks

Jary Pomponi, Mattia Merluzzi, Alessio Devoto, Mateus Pontes Mota, Paolo Di Lorenzo, Simone Scardapane

Introduction

Modern Deep Learning (DL) models are computationally intensive, posing significant challenges for deployment on resource-constrained IoT devices. While offloading tasks to edge servers can mitigate local constraints, fluctuating wireless channel conditions and latency requirements necessitate a more nuanced approach. This paper explores "goal-oriented" or semantic communication, where the primary objective is successful task completion (e.g., accurate classification) rather than perfect bit reconstruction. We propose a framework that dynamically balances local computation and edge offloading using recursive early exit neural networks and Reinforcement Learning (RL).

System Architecture and Methods

The proposed system consists of two main components: a Recursive Early Exit (EE) architecture and an RL-based optimization agent.

Recursive Early Exit (EE) Architecture

Unlike traditional early-exit models with independent classifiers, our recursive model integrates features from the current layer with predictions from previous exits. This approach utilizes "positive and negative moving mass" functions to refine class probabilities progressively. This recursive refinement ensures that confidence builds logically across layers, improving parameter efficiency and prediction stability.

RL-Based Online Optimization

A Q-learning agent manages the decision-making process at each inference step. Based on the current exit point and wireless channel quality (MCS), the agent selects one of three actions:

  1. Exit: Terminate and use the current local prediction.
  2. Compute: Proceed to the next local neural network layer.
  3. Offload: Transmit intermediate features to the edge server for final processing.
System architecture showing the interaction between the device side and the edge cloud server side during the inference process.

The agent is rewarded based on a "Goal Effectiveness" metric, which requires both classification accuracy (determined by a confidence margin) and completion within a strict deadline ($D_{max}$).

Experimental Setup

The framework was evaluated using the CIFAR-10 dataset with a ResNet-20 backbone modified to include nine recursive early exit points. The wireless environment was simulated within a 100m radius, accounting for Rayleigh fading and path loss to model realistic channel fluctuations.

Results and Discussion

The recursive model demonstrates a superior trade-off between inference accuracy and computational cost (FLOPs) compared to standard halting strategies like "highest probability" or "patience-based" halting.

Accuracy vs. FLOPs comparison showing the superior performance of the proposed recursive early exit model against baseline halting strategies.

Key findings include:

  • Efficiency: The proposed model achieves higher accuracy for the same computational budget.
  • Adaptability: The RL agent effectively learns to compute locally when channel conditions are poor and offload early when high-speed transmission is available, ensuring latency constraints are met.
  • Goal Effectiveness: The system maintains high accuracy (~85% on CIFAR-10) while strictly adhering to a 40ms deadline.

Conclusion

This research highlights the potential of combining recursive neural architectures with RL for goal-oriented communication in 6G networks. By prioritizing task success and resource efficiency, the framework enables robust DL performance on IoT devices. Future work will explore multi-agent scenarios and more complex tasks beyond image classification.

Summary updated

Abstract

This paper presents a novel framework for goal-oriented semantic communications leveraging recursive early exit models. The proposed approach is built on two key components. First, we introduce an innovative early exit strategy that dynamically partitions computations, enabling samples to be offloaded to a server based on layer-wise recursive prediction dynamics that detect samples for which the confidence is not increasing fast enough over layers. Second, we develop a Reinforcement Learning-based online optimization framework that jointly determines early exit points, computation splitting, and offloading strategies, while accounting for wireless conditions, inference accuracy, and resource costs. Numerical evaluations in an edge inference scenario demonstrate the method's adaptability and effectiveness in striking an excellent trade-off between performance, latency, and resource efficiency.
BibTeX
@inproceedings{pomponi2024goal,
  author = {Jary Pomponi and Mattia Merluzzi and Alessio Devoto and Mateus Pontes Mota and Paolo Di Lorenzo and Simone Scardapane},
  title = {{Goal-Oriented Communications Based on Recursive Early Exit Neural Networks}},
  booktitle = {IEEECONF},
  year = {2024},
  doi = {10.1109/ieeeconf60004.2024.10942792},
}
Figure