LoopMoEVR: Loop-Based Degradation-Aware Mixture-of-Experts for Unified UHD Video Restoration

Yucheng Xin, Runci Bai, Yongcong Wang, Guangwei Gao, Jiao Liu, Dianjie Lu, Linwei Fan, Zhuoran ZhengarXiv 2026 · arXiv

TL;DR

LoopMoEVR is a parameter-efficient, unified model for Ultra-High-Definition (UHD) video restoration that handles dehazing, deraining, denoising, and low-light enhancement. By employing a loop-based Mixture-of-Experts (MoE) architecture with adaptive inference depth, it achieves state-of-the-art performance using only 0.884M parameters—roughly a quarter of the size of previous leading models.

What Problem Does This Paper Address?

Restoring 4K (UHD) video is a massive computational challenge. Most existing "all-in-one" models attempt to improve generalization by simply stacking more layers, leading to bloated parameter counts and diminishing returns. Furthermore, these models typically have a fixed inference depth, meaning they spend the same amount of compute on a lightly noisy frame as they do on a heavily fogged one.

The authors identify a need for progressive refinement and adaptive depth within a limited parameter budget. They aim to create a single, compact model that can adapt its internal state and processing time based on the specific type and severity of degradation present in the video.

Methods

The core innovation of LoopMoEVR is the loop learning paradigm, where a single set of backbone parameters is reused across multiple iterations to progressively refine the video features.

Key components include:

  • Low-rank Loop Embedding: To ensure the shared backbone knows "where" it is in the restoration process and "what" it is fixing, the authors combine degradation representations (type and severity) with iteration indices using a low-rank residual mechanism.
  • IterAda3DN (Spatio-Temporal Iterative Adaptive Normalization): This module fuses local spatio-temporal features with global video context. It uses a "momentum" state to carry information across iterations, allowing the model to maintain temporal consistency.
  • State-aware Expert Modulation: The model uses a Mixture-of-Experts (MoE) approach. Unlike standard MoE, these experts are conditioned on the current video state (updated by attention in each loop), allowing for specialized processing that evolves as the image gets cleaner.
  • Dynamic Depth Predictor: An input-conditioned module that adaptively selects the number of loop iterations ($K \in \{3, 4, 5\}$). This allows the model to save power and time on easier restoration tasks.
Figure 3: Iterative restoration mechanism of LoopMoEVR. Degradation-conditioned low-rank loop embedding guides IterAda3DN and state-aware expert modulation to progressively refine video features within a parameter-shared loop.

Datasets

The primary benchmark used is UHV-4K-AIO, a specialized dataset for unified 4K video restoration covering four tasks: dehazing, deraining, denoising, and low-light enhancement.

For additional validation, the authors tested on:

  • MOT17 & DAVIS-test: Used to evaluate performance on non-UHD resolutions and evolving (time-varying) degradations.
  • Real-world UHD images: To test the model's ability to generalize beyond synthetic benchmarks.

Key Insights and Ideas

  • The Power of Re-use: The authors demonstrate that looping a compact backbone is nearly as effective as having a much deeper, non-shared network. A 4-stage loop achieved results within 0.08 dB PSNR of a model with four unique stages but used 71.6% fewer parameters.
  • Conditioning is Crucial for Unified Tasks: For a single model to handle multiple domains (like rain vs. low light), the conditioning mechanism must be robust. By integrating degradation type, severity, and iteration stage into the embeddings, the model successfully "reprograms" its shared weights for the task at hand.
  • Efficiency for Mobile: The extremely low parameter count (0.884M) makes this model a prime candidate for edge deployment. The authors successfully demonstrated 4K restoration on a smartphone.
Figure 1: Mean PSNR, parameter count, and reported inference time on UHV-4K-AIO.

Key Results

  • State-of-the-Art: LoopMoEVR achieved the highest mean PSNR (27.87 dB) on the UHV-4K-AIO benchmark, outperforming the previous best model, MoCRA, by 0.64 dB while being significantly smaller.
  • Temporal Stability: The model achieved a tLPIPS of 0.1182 and a Warping Error of 0.0297, indicating high consistency between video frames.
  • Adaptive Savings: The dynamic depth predictor saved approximately 8.9% in inference time by reducing iterations for simpler frames without sacrificing overall quality.
  • User Preference: In an anonymous user study of 100 participants, LoopMoEVR received the highest Mean Opinion Score (MOS 2.35) compared to other top video restoration methods.

Limitations and Future Work

  • Resolution Sensitivity: The authors noted that the model's advantage is less pronounced at lower (non-UHD) resolutions. They suggest this is because lower resolutions provide fewer high-frequency structural cues for the iterative loop to exploit.
  • Training Complexity: The training process is two-staged (restoration first, then depth predictor), which is more complex than standard end-to-end training.
  • Future Directions: Potential future work includes extending the model to handle more complex "hybrid" degradations (e.g., simultaneous rain and low light) and further optimizing the MoE routing for even lower latency.
Figure 2: 4K video restoration on a smartphone.

Summary updated

Abstract

Recently, unified high-definition image restoration has attracted considerable attention; however, existing models tend to excessively increase their depth in pursuit of improved generalization, which often yields only limited gains. Meanwhile, loop-based learning paradigms have drawn widespread attention due to their low parameter counts and strong regression capability, as exemplified by GPT-6 and looped Transformers. In this paper, we introduce the loop learning paradigm to address restoration tasks that require cross-domain learning. Specifically, we propose LoopMoEVR, a loop-based mixture-of-experts model capable of handling degraded ultra-high-definition (UHD) inputs. First, a degradation-conditioned low-rank loop embedding is designed to construct input-dependent stage conditions. Second, a spatio-temporal iterative adaptive normalization module, termed IterAda3DN, is developed to fuse local features with global loop context, thereby performing position-wise affine modulation. Finally, the expert branches further integrate the attention-updated local and global video states with the loop conditions to generate dedicated modulation parameters, while an input-conditioned depth predictor adaptively configures the number of loop iterations. With only approximately 0.884M trainable parameters, the proposed model uniformly handles UHD video dehazing, deraining, denoising, and low-light enhancement tasks, achieving state-of-the-art restoration performance on both public benchmarks and real-world scenarios.
BibTeX
@misc{xin2026loopmoevr,
  author = {Yucheng Xin and Runci Bai and Yongcong Wang and Guangwei Gao and Jiao Liu and Dianjie Lu and Linwei Fan and Zhuoran Zheng},
  title = {{LoopMoEVR: Loop-Based Degradation-Aware Mixture-of-Experts for Unified UHD Video Restoration}},
  year = {2026},
  eprint = {2610.05109},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.05109},
}
Figure