Towards High-Fidelity Learned Video Compression

Bumyoon Kim, Yongseong Kim, Inhyuk Jeong, Byeungwoo JeonarXiv 2026 · arXiv

TL;DR

This paper identifies "latent capacity"—the number of compressed values stored per pixel—as the fundamental bottleneck preventing learned video codecs from reaching professional high-fidelity standards. By reintroducing encoder-side search for motion and residual partitions, the authors developed a learned codec that successfully spans the entire quality range from standard VVC test conditions up to production-grade ProRes HQ.

What Problem Does This Paper Address?

While learned video compression has made massive strides in recent years, it has mostly targeted "consumer" bitrates where some loss of detail is acceptable. Professional workflows—such as film acquisition, post-production, and archiving—operate at much higher fidelity levels, typically using 10-bit YCbCr 4:2:2 formats.

Existing learned codecs hit a "quality ceiling" (often around 38 dB PSNR) because they rely on feed-forward neural networks with a fixed, low latent capacity. Even if you remove quantization entirely, these models cannot represent the fine details required for high-end production. The authors define a "professional quality range" between the lowest standard test condition (VVC at QP 37) and the high-quality grade of the industry-standard ProRes codec to benchmark this gap.

Methods

The authors propose a hybrid coding loop that combines the strengths of neural networks with the exhaustive search strategies of traditional codecs.

The proposed framework combines learned modules (pink) with encoder-side search (blue) to optimize rate-distortion cost.

Key technical innovations include:

  • Encoder-Side Search: Unlike "one-pass" learned encoders that apply a fixed mapping, this codec searches for the best block-based motion and residual partitions for every frame, minimizing a rate-distortion cost ($J = D + \lambda R$).
  • Variable Latent Capacity: The codec uses learned block transforms for sizes ranging from $4 \times 4$ to $64 \times 64$. Crucially, smaller blocks have a higher "latent capacity" (up to 1.0 latent values per sample for $4 \times 4$ blocks), allowing the model to allocate more "bandwidth" to complex textures.
  • Learned Refinement: While the search is traditional, the prediction refinement, transforms, and in-loop filters are all deep neural networks trained to handle 10-bit 4:2:2 video natively.

Datasets

  • Training: The model was trained on 2,590 clips from professional ProRes 4:2:2 sources and 160 sequences from the BVI-AOM dataset (converted to 4:2:2).
  • Evaluation: Performance was measured on six standard 10-bit YCbCr 4:2:2 sequences from the JVET test set (e.g., Kimono1, Traffic, EBUHorse).

Key Insights and Ideas

  • The Capacity Bottleneck: Most learned codecs are limited to a latent capacity of 0.25. The authors show that to reach professional fidelity, you need a capacity of at least 1.0. Without it, the network simply doesn't have enough "room" to store the necessary information, regardless of how fine the quantization is.
  • Closing the Amortization Gap: Feed-forward encoders suffer from an "amortization gap"—they are optimized for the average case but fail on specific, difficult content. Per-block searching at encoding time is essential to bridge this gap for high-fidelity applications.
  • Motion Search vs. Optical Flow: The paper finds that traditional block-based motion search handles distant reference frames significantly better than the optical flow methods typically favored in the learned compression literature.

Key Results

The proposed codec is the first learned model to successfully reach the upper end of the professional quality range (ProRes HQ) across all test sequences.

Figure 1. Rate-distortion curves averaged over six JVET 4:2:2 se- quences. The band marks the comparison range, from VVC at QP 37 to ProRes HQ. Four learned codecs stop near 38 dB, whereas the proposed codec reaches the upper end of the range.
  • Range Coverage: Previous state-of-the-art learned codecs only covered 24% to 38% of the professional quality range. The proposed adaptive codec covers 100%.
  • Visual Fidelity: As shown in Figure 5, the adaptive partitioning allows the codec to capture fine structures like water streaks that fixed-capacity models blur out.
Figure 5. EBUWaterRocksClose, frame 16, a crop of 160×160 luma samples: reconstructions with the PSNR of the crop (top) and their absolute luma error (bottom). BRHVC is reconstructed without quantization, and our codec is at pQP 7.

Limitations and Future Work

  • Bitrate Efficiency: While it reaches high quality, the codec is currently less efficient than VVC and HEVC, requiring more bits to achieve the same PSNR.
  • Computational Complexity: Encoding is slow, taking between 2 and 8.5 seconds per 1080p frame on a high-end GPU (RTX 6000).
  • Incomplete System: The current evaluation focuses on inter-frame coding; intra frames (I-frames) are still provided by external sources. The authors aim to close the rate gap and integrate intra-coding in future work.

Summary updated

Abstract

Professional video workflows operate at qualities that learned video codecs do not reach. We measure how much of a professional quality range a codec covers, from the lowest quality of the standard test conditions, VVC at QP 37, to the highest 4:2:2 grade of the production codec ProRes. To compare inter-frame coding alone, every codec receives original frames as references at the intra positions. On 10-bit YCbCr 4:2:2 test sequences, four recent learned codecs cover 24 to 38% of this range. Their encoders are feed-forward networks with a fixed latent capacity, the number of latent values per sample, of at most 0.25, and removing their quantization raises the quality by at most 1 dB. We propose a learned inter-frame codec whose encoder searches, as the encoders of conventional codecs do. It searches block motion, which a learned network refines, and it searches among learned block transforms whose latent capacity ranges up to 1, selecting the partition, the skip decisions, and the quantized coefficients by a rate-distortion cost. Our codec reaches the upper end of the range on all six sequences. With all residual blocks fixed to 16x16, whose latent capacity is 0.25, the same codec covers 55% of the range, with or without quantization.
BibTeX
@misc{kim2026towards,
  author = {Bumyoon Kim and Yongseong Kim and Inhyuk Jeong and Byeungwoo Jeon},
  title = {{Towards High-Fidelity Learned Video Compression}},
  year = {2026},
  eprint = {2611.25731},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.25731},
}
Figure