GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networks

Feng Xie, Jiagao Hu, Fuhao Li, Zepeng Wang, Yuxuan Chen, Dahua Gao, Fei Wang, Daiguo ZhouarXiv 2026 · arXiv

TL;DR

GRNEdit is a highly efficient, lightweight framework that reframes instruction-based video editing as simple "retain-or-flip" decisions over binary latents rather than complex continuous feature regression. By leveraging Generative Refinement Networks (GRNs) and a two-stage alignment process, it achieves state-of-the-art video editing quality while using less than 3% additional conditioning parameters.

What Problem Does This Paper Address?

Most state-of-the-art video editing models operate within the continuous latent spaces of large diffusion or flow-matching backbones. To inject editing instructions and source video context, these systems typically rely on heavyweight conditioning branches (like copied network blocks or adapters) or computationally expensive source token concatenation.

The fundamental challenge is that these continuous models must simultaneously solve two hard problems: where to edit (localization) and what high-dimensional values to generate (synthesis). As generative backbones scale up, the computational cost and optimization burden of these conditioning paths grow prohibitively large. The authors ask a compelling question: Can content synthesis remain entirely with the pretrained backbone, while a lightweight branch models only the editing intent?

Methods

GRNEdit achieves this separation by building on top of Generative Refinement Networks (GRNs), which encode video latents as hierarchical binary codes using Hierarchical Binary Quantization (HBQ). Because the source and target videos share aligned binary coordinates, editing simply requires deciding whether to retain or flip individual bits.

Overview of GRNEdit

The framework operates in two distinct stages:

  1. Stage I: Evidence Assimilation and Identity Anchoring: Lightweight source encoders map source bits into continuous "evidence" signals at selected Transformer chunks. Crucially, the authors redefine the classic "null-prompt" dropout used in classifier-free guidance. Instead of dropping the text condition to perform unconditional generation, an empty instruction is explicitly treated as a command to perform no edit, supervised directly via source video reconstruction. This anchors the model's ability to preserve unedited content.
  2. Stage II: Identity-Referenced Bit-Margin Revision: The framework freezes Stage I and uses the identity path to generate a "source-preserving" reference state in the exact same representation space as the edited state. A lightweight Bit-Margin Router directly compares the edited logits with this preservation reference, using the discrepancy to cleanly revise residual errors and restore fine details.
Overview of GRNEdit

Datasets

  • Training: The models were trained on a task-balanced subset of 0.6M training pairs derived from the public OpenVE-3M dataset. Multimodal Large Language Models (MLLMs) were used to generate source-aware reprompts to enrich the text instructions.
  • Evaluation: The framework was evaluated using OpenVE-Bench (evaluating instruction following, source preservation, and temporal quality across 8 editing tasks) and ReCo-Bench (focusing on Add, Replace, Remove, and Style tasks).

Key Insights and Ideas

  • The Binary Advantage: Quantizing the video into bits reduces the local search space from an infinite continuum (or a massive discrete codebook) to a simple binary choice. This shifts the conditioning path's job from synthesis to localization-only control.
  • Source as "Evidence", Not Features: Instead of treating the source video as a residual target representation to be mathematically combined with the generation, it is treated as coordinate-wise evidence that biases the backbone's native binary decision axis.
  • Identity Anchoring: Reinterpreting the null condition as an identity mapping provides a perfect, coordinate-aligned baseline for preservation. This allows Stage II to perform precise logit-level corrections by simply looking at where the edited stream drifted too far from the preservation stream.
Visualizing Source-Induced Changes

Key Results

  • State-of-the-Art Efficiency: GRNEdit-2B and GRNEdit-8B achieved overall scores of 4.03 and 4.18 on OpenVE-Bench, respectively.
  • Outperforming Larger Models: The 2B parameter model outperformed multiple 14B open-source video editors, while requiring less than 3% additional conditioning parameters (only 37M parameters for the 2B model and 45M for the 8B model).
  • Speed: Due to its lightweight conditioning architecture, per-video inference times were remarkably low: 39 seconds for the 2B model and 84 seconds for the 8B model.
  • Excellent Localization: GRNEdit performed exceptionally well on localization-sensitive tasks, securing top open-source scores for Background Change and Local Remove tasks.

Limitations and Future Work

The authors note a key structural limitation: Object Addition (the ADD task). Because the binary evidence perspective relies on modifying or retaining existing source structures, it struggles when the target semantics are entirely absent from the source video (e.g., adding a flying seagull to an empty sky). In these scenarios, the lightweight evidence path faces a preservation-generation conflict that it lacks the capacity to fully resolve.

Future work includes allocating richer semantic capacity specifically for object-addition tasks, implementing region-aware gating to relax source preservation in edit zones, and incorporating higher-quality training data that provides stronger physical supervision (shadows, occlusions, and lighting reflections).

Summary updated

Abstract

Instruction-based general video editing seeks to unify diverse editing operations within a single, intuitive interface. Existing approaches often rely on resource-intensive conditioning, using either heavyweight branches or costly source concatenation. Is there any efficient way to model editing intent? Thus, we introduce GRNEdit, a lightweight two-stage framework. GRN inspires our approach by encoding visual semantics through combinations of bits. Through task-specific fine-tuning, we take this representation further and recast editing semantics as local retain-or-flip decisions over individual bits. Source information is consequently modeled as coordinate-wise evidence supporting the observed binary states, while the GRN backbone remains responsible for resolving their global composition into coherent generative semantics. In Stage I, a compact encoder translates discrete source codes into continuous evidence signals, which GRN assimilates throughout binary refinement. Inspired by null-prompt training for classifier-free guidance, we further assign the null condition an editing-specific meaning: an empty instruction denotes no edit and is supervised through source reconstruction. This identity pathway not only implicitly strengthens evidence utilization and content preservation in Stage I, but also produces a source-preserving state in the same representation space as the edited state. Stage II can therefore directly compare each edited state with its source-preserving counterpart and use their discrepancy to revise unresolved target-bit decisions. Trained on only 0.6M pairs with less than 3\% conditioning parameters, GRNEdit-2B and GRNEdit-8B achieve scores of 4.03 and 4.18 on OpenVE-Bench. The 2B model outperforms multiple 14B open-source editors, while the 8B model performs on par with leading open-source editors.
BibTeX
@misc{xie2026grnedit,
  author = {Feng Xie and Jiagao Hu and Fuhao Li and Zepeng Wang and Yuxuan Chen and Dahua Gao and Fei Wang and Daiguo Zhou},
  title = {{GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networks}},
  year = {2026},
  eprint = {2608.16328},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2608.16328},
}
Figure