Abstract
The Metaverse will provide numerous immersive applications for human users, by consolidating technologies like extended reality (XR), video streaming, and cellular networks. Optimizing wireless communications to enable the human-centric Metaverse is important to satisfy the demands of mobile users. In this paper, we formulate the optimization of the system utility-cost ratio (UCR) for the Metaverse over wireless networks. Our human-centric utility measure for virtual reality (VR) applications of the Metaverse represents users' perceptual assessment of the VR video quality as a function of the data rate and the video resolution, and is learnt from real datasets. The variables jointly optimized in our problem include the allocation of both communication and computation resources as well as VR video resolutions. The system cost in our problem comprises the energy consumption and delay, and is non-convex with respect to the optimization variables due to fractions in the mathematical expressions. To solve the non-convex optimization, we develop a novel fractional programming technique, which contributes to optimization theory and has broad applicability beyond our paper. Our proposed algorithm for the system UCR optimization is computationally efficient and finds a stationary point to the constrained optimization. Through extensive simulations, our algorithm is demonstrated to outperform other approaches.
Introduction
The Metaverse promises to revolutionize digital interaction through immersive Extended Reality (XR) and high-fidelity video streaming. However, delivering these experiences over wireless networks presents a significant challenge. Traditional network optimization focuses on Quality of Service (QoS)—objective metrics like bit rate or packet loss. In the Metaverse, the ultimate arbiter of quality is the human user. This paper argues for a shift toward Quality of Experience (QoE), balancing high-resolution video delivery against the energy and latency constraints of mobile devices.
The Human-Centric Framework
The core of our approach is the formulation of the System Utility-Cost Ratio (UCR). This metric balances human-centric utility—representing users' perceptual assessment of VR video quality—against the system cost, which includes energy consumption and delay.
The utility function is modeled using logarithmic functions to represent the diminishing returns of video quality as data rates and resolutions increase. To ensure the model reflects real-world human perception, we utilized datasets such as SSV360 (subjective quality assessments in different physical postures) and the Netflix VMAF dataset. Our findings indicate that users' physical states (seated vs. standing) significantly influence their perception of quality, with seated users often reporting higher UCRs.
Optimization via Fractional Programming
Mathematically, the UCR optimization problem is non-convex and involves a "sum-of-ratios," making it notoriously difficult to solve using standard techniques. We developed a novel fractional programming (FP) technique to find a stationary point for this constrained optimization, addressing gaps in existing literature regarding FP-minimization.
Our proposed Algorithm A1 employs a three-level iterative process:
- Outer level: Handles the main ratio using Dinkelbach’s transform.
- Middle level: Uses Alternating Optimization to toggle between optimizing video resolution and other resources.
- Inner level: Employs the new FP technique to optimize remaining variables like bandwidth and transmission power.
Key Insights and Results
Our research identified a "sweet spot" for video resolution. In resource-constrained wireless environments, pushing resolution beyond a certain point (e.g., from 1080p to 4K) often yields negligible perceptual gains while significantly increasing system costs.
Extensive simulations demonstrate that our algorithm significantly outperforms traditional approaches:
- Efficiency: Achieved a UCR improvement of 522% to 630% compared to standard average allocation methods.
- Latency Guarantees: Successfully maintained per-frame delays under 7ms, well within the 11ms threshold required for 90 FPS VR to prevent motion sickness.
- Robustness: The algorithm remained effective as the user count scaled from 10 to 160, demonstrating its scalability for dense Metaverse environments.
Conclusion
By prioritizing human perception and introducing a novel mathematical framework for fractional programming, this work provides a robust solution for resource allocation in the Metaverse. While our algorithm finds high-quality stationary points, future work will explore global optimization strategies and real-world implementation on live wireless testbeds.
Summary updated