QoE-Aware Service Provision for Mobile AR Rendering: An Agent-Driven Approach

Conghao Zhou, Lulu Sun, Xiucheng Wang, Peng Yang, Feng Lyu, Sihan Lu, Xuemin ShenarXiv 2025 · DOI · arXiv

Introduction

Mobile Augmented Reality (MAR) applications demand high-precision pose estimation to synchronize virtual overlays with the physical environment. To mitigate device power consumption, these computationally intensive tasks are frequently offloaded to edge servers. However, supporting MAR in 6G networks faces two primary challenges: domain silos between network controllers and service providers, and the inherent volatility of user movement. Network controllers often lack visibility into application-specific rendering logic, while service providers are unaware of real-time network constraints. This paper proposes an LLM-powered "Digital Agent" to bridge this gap, enabling personalized, Quality of Experience (QoE)-aware resource management.

The Agent-Driven Service Provisioning Framework

The core of the proposed solution is a cross-layer architecture that facilitates communication between the network and service domains. By using a tool-calling framework, the agent enables personalized resource management that adapts to individual user movements while keeping sensitive application data private.

The proposed Agent-Driven Service Provisioning framework architecture, illustrating the interaction between the Digital Agent, the network controller, and the Service Function Toolkit (SFT).

As shown in the architecture above, the framework consists of three primary components:

  1. Digital Agent (DA): Utilizing a Large Language Model (LLM) core, the DA serves as an intelligent intermediary. It processes natural language prompts from the network controller and translates them into structured commands for specialized tools.
  2. Service Function Toolkit (SFT) and MCP: The agent interacts with tools via the Model Context Protocol (MCP). A key tool is the Future QoE Prediction Tool, which integrates the service provider's pose prediction model with a Kalman Filter for adaptive bias correction, allowing for accurate real-time predictions despite user movement variability.
  3. Donor-Receiver Resource Algorithm: This algorithm optimizes bandwidth allocation by identifying "donor" users with surplus resources and reallocating them to "receiver" users experiencing declining QoE.

Experimental Methodology

The framework was evaluated using a real-world 6DoF pose dataset featuring head movement trajectories from 40 subjects viewing a volumetric video titled "Longdres." This dataset captures the non-stationary nature of human behavior in AR environments, providing a rigorous testbed for the agent's predictive capabilities.

Key Results and Discussion

The proposed agent-driven approach was benchmarked against a Base Transformer (BT) trained on general data and a Personalized Transformer (PT) trained on individual history.

Comparison of User Category Accuracy, demonstrating the superior performance and stability of the proposed agent-driven approach over Transformer-based benchmarks.

The results indicate that the proposed method significantly outperforms the benchmarks in both Mean Squared Error (MSE) and User Category Accuracy. Unlike the Personalized Transformer, which often fails when encountering novel user behaviors, the agent-driven approach maintains stability by leveraging the underlying physics and rendering logic of the AR application.

Furthermore, the system demonstrated high resource efficiency. In a five-user simulation, the framework successfully redistributed bandwidth from stable users to those with dropping QoE, enhancing overall group immersion without increasing total spectrum usage.

Conclusion and Future Work

This research demonstrates that LLMs can serve as effective reasoning bridges in complex network environments, preserving privacy by sharing QoE insights rather than raw data. Future work will address the latency of the LLM reasoning loop to meet the millisecond requirements of 6G and explore scaling the architecture for high-density user environments. Moving toward "intent-driven" interaction will further enable autonomous negotiation between networks and service agents.

Summary updated

Abstract

Mobile augmented reality (MAR) is envisioned as a key immersive application in 6G, enabling virtual content rendering aligned with the physical environment through device pose estimation. In this paper, we propose a novel agent-driven communication service provisioning approach for edge-assisted MAR, aiming to reduce communication overhead between MAR devices and the edge server while ensuring the quality of experience (QoE). First, to address the inaccessibility of MAR application-specific information to the network controller, we establish a digital agent powered by large language models (LLMs) on behalf of the MAR service provider, bridging the data and function gap between the MAR service and network domains. Second, to cope with the user-dependent and dynamic nature of data traffic patterns for individual devices, we develop a user-level QoE modeling method that captures the relationship between communication resource demands and perceived user QoE, enabling personalized, agent-driven communication resource management. Trace-driven simulation results demonstrate that the proposed approach outperforms conventional LLM-based QoE-aware service provisioning methods in both user-level QoE modeling accuracy and communication resource efficiency.
BibTeX
@misc{zhou2025qoe,
  author = {Conghao Zhou and Lulu Sun and Xiucheng Wang and Peng Yang and Feng Lyu and Sihan Lu and Xuemin Shen},
  title = {{QoE-Aware Service Provision for Mobile AR Rendering: An Agent-Driven Approach}},
  year = {2025},
  eprint = {2508.08627},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2508.08627},
}
Figure