A Rate-Distortion Optimized Skip Mode Coding Framework for Neural Video Compression in AVS

Yuntian Jiang, Shuai Li, Yanbo Gao, Jinglin Zhang, Hui Yuan, Mao YearXiv 2026 · arXiv

TL;DR

This paper introduces RDOSkip, a rate-distortion optimized skip mode framework for neural video compression (NVC). By replacing rigid, fixed-threshold skip decisions with an adaptive method that accounts for spatial and temporal distortion variations, the authors achieve significant bitrate savings (up to 1.29% BD-rate) with zero retraining and negligible computational overhead.

What Problem Does This Paper Address?

In video compression, "skip mode" is a powerful tool: if a part of a frame can be accurately predicted from previous frames, we simply "skip" encoding the residual (the difference) to save bits. In traditional codecs like HEVC, this decision is made using rigorous Rate-Distortion Optimization (RDO).

However, in Neural Video Compression (NVC), skip mode has been handled much more crudely. Most current NVC frameworks use a fixed threshold based on the variance predicted by a hyperprior. If the predicted variance is low, the system assumes the prediction is "good enough" and skips it.

The authors identify a major flaw here: variance does not equal distortion. As shown in the figure below, feature elements with the same variance can result in wildly different Mean Squared Error (MSE) in the final reconstructed image. Furthermore, the sensitivity to these errors changes depending on which feature channel you are in and the quality of the reference frame used for prediction.

Fig. 2: MSE variation in the image domain vs. feature loss. Note how different channels (b) and variances (a) lead to different distortion responses.

Methods

The researchers propose a framework that bridges the gap between feature-domain decisions and pixel-domain results.

  1. Bayesian Distortion Formulation: They use Bayes' theorem to derive a mathematical link between the loss in the latent feature domain ($|\Delta y|$) and the resulting MSE in the reconstructed pixels. This allows the encoder to estimate the "cost" of skipping a feature without actually running the full decoder.
  2. Spatially Adaptive Thresholds: Instead of one threshold for the whole frame, RDOSkip calculates channel-wise thresholds. It uses the first and second-order statistics (mean and standard deviation) of the predicted variances within a channel to proxy the "Jacobian matrix" of the decoder—essentially measuring how sensitive a specific channel is to noise.
  3. Temporally Adaptive Thresholds: The quality of a video frame in NVC often depends on its position in a Group of Pictures (GOP). RDOSkip adjusts the skip threshold based on the Lagrange multiplier ($\lambda$) of the current frame and its reference frame, accounting for the fact that low-quality references make residuals harder to skip.
  4. Inference-Only Integration: Crucially, this method is "plug-and-play." It requires no retraining of the underlying neural networks and can be directly applied to existing NVC models during inference.
Fig. 4: Overview of the NVC architecture with the integrated RDOSkip module.

Datasets

The authors evaluated their framework using:

  • Training: Vimeo-90K and BVC-DVC datasets.
  • Testing/Evaluation: The AVS common test sequences (HUD4K, 1080p, 720p), the HEVC dataset (Classes B, C, D, and E), UVG, and MCL-JCV.

Key Insights and Ideas

  • Skip Mode is Dominant: The authors show that in NVC, skip ratios are incredibly high—often over 90% for motion vectors at low bitrates. This makes optimizing the skip decision one of the highest-leverage ways to improve overall efficiency.
  • Sensitivity Matters: Some feature channels are "information-rich" and highly sensitive to noise, while others are robust. A fixed threshold ignores this, either wasting bits on robust channels or introducing artifacts in sensitive ones.
  • The Reference Quality Ripple Effect: In hierarchical coding structures, the distortion distribution changes significantly based on reference frame quality. RDOSkip is the first work to explicitly model this temporal dependency for NVC skip modes.
Fig. 1: The skip ratio of motion and residual features, on the BQTerrace sequence. The skip ratio refers to the percentage of skipped elements in the latent feature using the AVS-EEM.

Key Results

  • BD-Rate Savings: The method achieved an average of 0.90% BD-rate saving on AVS test sequences and 1.29% on HEVC sequences compared to the baseline AVS-EEM codec.
  • Standardization: The temporal skip mode decision component was successful enough to be adopted into the ongoing AVS NVC standard (as contribution M8789).
  • Complexity: The computational overhead is negligible. In fact, because the method skips more "unimportant" feature elements more accurately, it can slightly increase decoding speed (FPS) by reducing the workload for entropy decoding.

Limitations and Future Work

  • Heuristic Hyperparameters: The adaptive thresholds rely on four hyperparameters ($\alpha, \beta, \gamma, \epsilon$) that were empirically set. While they proved robust across different GOP sizes and datasets, a more automated or learned way to determine these per-model could be beneficial.
  • Focus on Residuals: This paper primarily focuses on skip mode for residual features. While motion vector skip ratios are already very high, applying a similar RD-optimized logic to motion features specifically might yield further (albeit smaller) gains.

Summary updated

Abstract

With the development of deep learning, neural video compression (NVC) is gaining increasing interest and is currently under standardization in the AVS (Audio Video Coding Standard). Skip mode coding, a crucial component in the traditional video compression, is also adopted in AVS NVC. Although the skip mode takes a large portion in encoding the motion and residual features in the NVC, there is a lack of investigation on the rate distortion performance of the skip mode coding. In this paper, we first thoroughly investigate the rate and distortion distribution in the skip mode coding within a spatial frame and under different temporal reference qualities, and demonstrate that distortion distribution changes spatially and temporally. Therefore, a rate-distortion optimized skip mode coding (RDOSkip) framework is proposed, where the rate and distortion in the skip mode coding is formulated based on a statistical distribution predicted by the hyperprior and the Bayes' theorem. An adaptive skip mode decision method based on spatial-temporal joint RD optimization is developed for the skip mode coding among channels and frames in a group of pictures. It addresses the limitation of the rigid fixed-distortion distribution assumption in skip mode coding within the existing methods that rely on a fixed skip threshold. The temporal skip mode decision method has been adopted in the ongoing AVS NVC standard and incorporated into the reference software. The proposed RDOSkip can be directly used in the inference without any training and with negligible complexity increase. Experimental results further demonstrate that the proposed RDOSkip can improve the performance by 0.90% and 1.29% on AVS and HEVC datasets, respectively, in terms of BD-rate saving.
BibTeX
@misc{jiang2026rate,
  author = {Yuntian Jiang and Shuai Li and Yanbo Gao and Jinglin Zhang and Hui Yuan and Mao Ye},
  title = {{A Rate-Distortion Optimized Skip Mode Coding Framework for Neural Video Compression in AVS}},
  year = {2026},
  eprint = {2611.00181},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.00181},
}
Figure