Experimental Study of Low-Latency Video Streaming in an ORAN Setup with Generative AI

Andreas Casparsen, Van-Phuc Bui, Shashi Raj Pandey, Jimmy Jessen Nielsen, Petar PopovskiarXiv 2024 · DOI · arXiv

TL;DR

This paper proposes a proactive, cross-layer approach to live video streaming in Open Radio Access Networks (ORAN). By leveraging millisecond-level radio metrics to trigger video downscaling before congestion occurs and using Generative AI (GAI) at the mobile edge for high-quality reconstruction, the researchers eliminated latency spikes over 600 ms and improved visual quality by up to 4 dB PSNR.

What Problem Does This Paper Address?

Live video streaming over mobile networks faces a fundamental "reactive" problem. Traditional Adaptive Bit Rate (ABR) and congestion control algorithms (like Probe-and-Adapt) only respond after the network is already congested—once packets are dropped or buffers are full. This leads to visible stuttering, buffering, and massive latency spikes, which are unacceptable for real-time applications like industrial IoT or remote monitoring.

Furthermore, the Uplink (UL) from a user device is often much weaker than the Downlink (DL) due to the device's limited power and hardware. When a device tries to stream high-quality video over a degrading uplink, the network quickly becomes a bottleneck.

Methods

The authors introduce a Proactive Congestion Control (PCC) architecture integrated into an ORAN environment. The key components include:

  1. Semantic Control Channel: An ORAN xApp (a software application running on the Radio Intelligent Controller) monitors low-level Radio Access Network (RAN) metrics, specifically Signal-to-Noise Ratio (SNR), on a millisecond timescale.
  2. Proactive Adaptation: Instead of waiting for application-layer feedback, the Mobile Edge Compute (MEC) server uses these RAN metrics to proactively instruct the transmitting User Equipment (UE) to downscale its video resolution before the link fails to support the current bitrate.
  3. GAI-based Reconstruction: When the MEC receives downscaled, low-bitrate video, it doesn't just forward it. It passes the frames through a Generative AI module (specifically the RealSR model) to reconstruct high-quality frames.
  4. Edge Offloading: The heavy lifting of GAI upscaling is done at the MEC server, which has access to powerful GPUs (an NVIDIA RTX 4080 in their testbed). This saves the battery and processing power of the receiving mobile device while taking advantage of the typically higher capacity of the Downlink.
Fig. 1: Proposed system for GAI-based MEC and CN.

Datasets

The system was evaluated using 50 randomly selected videos from a dataset focused on content moderation for children's videos (Ahmed et al., 2023). These videos were streamed through a live ORAN testbed to simulate real-world fluctuating channel conditions.

Key Insights and Ideas

  • Trading Compute for Communication: The core philosophy is that in modern networks, computational power at the edge is often more "affordable" than scarce or fluctuating wireless bandwidth. Using a GPU to "hallucinate" missing details (GAI) is a viable way to compensate for a poor radio link.
  • Cross-Layer Synergy: The paper demonstrates that ORAN’s ability to expose low-level metrics (like SNR) to the application layer is a game-changer. It allows the video encoder to "see" a coming storm in the radio environment before the first packet is even delayed.
  • Proactive vs. Reactive: As shown in the sequence diagram below, the proactive "Reduce" command sent to UE1 allows the system to maintain a steady flow of frames, even if they are lower resolution, which the GAI then fixes.
Fig. 2: Application of GAI in a video streaming context.

Key Results

The experimental results on the live testbed were significant:

  • Latency Stability: The proactive approach completely eliminated the "latency tail"—spikes exceeding 600 ms that plagued traditional reactive methods.
  • Visual Fidelity: The GAI-based reconstruction provided up to 4 dB gain in PSNR (Peak Signal-to-Noise Ratio) and a 15-point improvement in VMAF (Video Multi-Method Assessment Fusion) compared to traditional interpolation methods.
  • Resilience: Even under aggressive downscaling (keeping only 5% to 20% of original pixels), the GAI-based system maintained much higher perceptual quality scores than the baseline.
Fig. 4: CDF of PSNR under different downscaling factors (ϵ).

Limitations and Future Work

While promising, the authors acknowledge several hurdles:

  • MEC Compute Load: GAI is computationally expensive. In a real-world deployment with thousands of users, the MEC would need massive resources to upscale every stream in real-time.
  • GAI Generalization: The performance of GAI depends heavily on its training data. If the live video content differs significantly from the training set (domain mismatch), the reconstruction quality might drop.
  • Optimization Trade-offs: Future work is needed to formalize the "bitrate-compute-quality" trade-off as a mathematical optimization problem, helping providers decide exactly when to trigger GAI based on available GPU cycles and power costs.

Summary updated

Abstract

Current Adaptive Bit Rate (ABR) methods react to network congestion after it occurs, causing application layer buffering and latency spikes in live video streaming. We introduce a proactive semantic control channel that enables coordination between Open Radio Access Network (ORAN) xApp, Mobile Edge computing (MEC), and User Equipment (UE) components for seamless live video streaming between mobile devices. When the transmitting UE experiences poor Uplink (UL) conditions, the MEC proactively instructs downscaling based on low-level RAN metrics, including channel SNR updated every millisecond, preventing buffering before it occurs. A Generative AI (GAI) module at the MEC reconstructs high-quality frames from downscaled video before forwarding to the receiving UE via the typically more robust Downlink (DL). Experimental validation on a live ORAN testbed with 50 video streams shows that our approach reduces latency tail behavior while achieving up to 4 dB improvement in PSNR and 15 points in VMAF compared to reactive ABR methods. The proactive control eliminates latency spikes exceeding 600 ms, demonstrating effective cross-layer coordination for latency-critical live video streaming.
BibTeX
@misc{casparsen2024experimental,
  author = {Andreas Casparsen and Van-Phuc Bui and Shashi Raj Pandey and Jimmy Jessen Nielsen and Petar Popovski},
  title = {{Experimental Study of Low-Latency Video Streaming in an ORAN Setup with Generative AI}},
  year = {2024},
  eprint = {2412.12751},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2412.12751},
}
Figure