Decoupling Direction and Magnitude: Language-Steered Flow Matching for Super-Resolution in the Dark

Jiaxin Gao, Ziyu Yue, Yaohua Liu, Danchen Cui, Zhihui Zhao, Zhixun SuarXiv 2026 · arXiv

TL;DR

DeLang-SR introduces a one-step flow-matching framework for low-light super-resolution that solves the problem of "one-size-fits-all" restoration. By explicitly decoupling the direction of restoration (steered by structured degradation language) from its magnitude (controlled by a spatially varying update-strength field), it achieves state-of-the-art results in brightening and sharpening dark images while avoiding the artifacts typically caused by uniform global updates.

What Problem Does This Paper Address?

Super-resolution in the dark is a nightmare for standard generative models because of spatial heterogeneity. In a single low-light photo, some regions might be pitch black and buried in noise, requiring aggressive reconstruction, while other regions (like those near a streetlamp) are relatively well-exposed and only need a light touch.

Standard diffusion and flow-matching models typically apply a globally uniform restoration trajectory. This creates a "mismatch": if the model is too aggressive, it hallucinates textures in reliable areas; if it’s too conservative, it fails to recover details from the shadows. The authors argue that we need a way to tell the model not just what to fix, but how much to fix at every single pixel.

Methods

DeLang-SR is built upon the Stable Diffusion 3 (SD3) flow-matching architecture, adapted via parameter-efficient LoRA modules. Its core innovation lies in the decoupling of two factors:

  1. Direction Steering (The "What"): The model translates measurable physical statistics (like exposure gap, shadow noise, and color shift) into structured degradation language. For example, it might generate a prompt like: "Restore a real low-light image with severe underexposure and high shadow noise." This semantic intent is combined with visual degradation tokens (local features like luminance and contrast) to steer the velocity field toward a high-quality image manifold.
  2. Magnitude Control (The "How Much"): Instead of a uniform step, the model predicts a Spatial Update-Strength Field ($M_\phi$). This field acts as a locally varying Euler step-size map. In dark, noisy regions, $M_\phi$ is high, allowing for a large corrective leap. In reliable regions, $M_\phi$ is low, enforcing a conservative update that preserves original details.
Figure 1: Pipeline of DeLang-SR. Degradation language and visual tokens form Hd to steer the SD3 velocity direction, while the continuous descriptor and local evidence predict Mϕ(y, δ) to control spatial update magnitude. During inference, (δ, ℓd) are estimated by Vtest(y) without GT, and the restored image is obtained by a single direction-steered and magnitude-controlled flow update. Let x denote the paired high-quality target during training. We write the SD3 VAE latents as zy = Evae(y) and zx = Evae(x). Under the SD3 flow-matching formulation [8, 23, 27], the transformer predicts a velocity field vθ(zt, t, H). Instead of iterative sampling, DeLang-SR performs a single degradation-controlled Euler update:

The final restoration is performed in a single step, making it significantly more efficient than iterative diffusion processes.

Datasets

The authors evaluated DeLang-SR across several benchmarks:

  • RELLISUR: A primary paired dataset specifically designed for joint low-light enhancement and super-resolution.
  • DarkFace: A collection of real-world nighttime scenes used for no-reference evaluation to test generalization.
  • LOL-v2-Real & LSRW: Used for cross-dataset transfer experiments to ensure the model isn't just "overfitting" to one type of darkness.

Key Insights and Ideas

  • Decoupling is Essential: By separating the direction of the flow from the magnitude of the update, the model can handle the extreme contrast of low-light scenes without needing complex cascaded pipelines.
  • Language as a Physical Interface: Rather than relying on manual prompts, the system automatically maps raw image statistics to natural language. This allows the model to tap into the massive generative priors of text-to-image models (like SD3) using a familiar "interface."
  • Interpretable Restoration: The update-strength map ($M_\phi$) provides a "heat map" of where the model is working hardest. This makes the black-box nature of generative restoration much more transparent.
Figure 2: Visualization of the update-strength map Mϕ(y, δ). Both ℓd and δ are estimated from y without GT. The map provides an interpretable spatial step-size field for one-step SD3 restoration.

Key Results

DeLang-SR consistently outperformed both deterministic backbones (like Restormer and HAT) and recent generative methods (like DHGM and DOD).

  • Quantitative Gains: On the RELLISUR $\times 2$ task, DeLang-SR achieved a PSNR of 23.865, a significant jump over the previous best generative method, DHGM (22.663). It also led in perceptual metrics like LPIPS and DISTS.
  • Efficiency: Despite being based on a large SD3 model, the one-step approach allows for inference times (~0.44s) that are competitive with or faster than many multi-step diffusion models.
  • Qualitative Superiority: Visual results show that DeLang-SR preserves sharper structures and more faithful colors in "extreme dark" regions where other models produce blurry or color-shifted results.
Figure 5: Visual comparison of all competing methods on RELLISUR (Top two:×2, Bottom two:×4). More RELLISUR visual comparisons under ×2 and ×4 settings are provided in Appx. G.6.

Limitations and Future Work

While powerful, DeLang-SR still carries the computational footprint of a large pretrained transformer (SD3). While the one-step inference is fast, the memory requirements remain high. Additionally, in "pitch black" regions with zero signal, the model may still hallucinate plausible but technically "fake" details—a common trait of all generative restoration.

The authors suggest future work could explore lightweight flow priors to reduce the model size and uncertainty-aware estimation to better calibrate the update-strength field in ambiguous regions.

Summary updated

Abstract

Image super-resolution in the dark is fundamentally challenged by extreme spatial heterogeneity: severely underexposed and noisy regions demand aggressive generative enhancement to reconstruct missing details, while relatively well-exposed areas require conservative updates to prevent hallucinated textures. Standard diffusion and flow-matching models, however, rely on globally uniform integration trajectories, making them sub-optimal for such spatially varying degradations. In this paper, we propose DeLang-SR (Degradation-Language steered Super-Resolution), a one-step flow-matching framework that explicitly decouples the restoration direction and magnitude. Rather than treating low-light corruption as arbitrary latent features, DeLang-SR translates measurable physical statistics into structured degradation language, harnessing the semantic prior of pretrained text-to-image models. The degradation-language intent, complemented by image-specific visual tokens, steers the velocity field (direction) toward restoration-relevant manifolds. Simultaneously, a continuous spatial update-strength field acts as a locally varying Euler step-size field (magnitude), applying stronger integration steps in heavily degraded shadows while enforcing conservative updates in reliable regions. Experiments on paired and real dark images, together with ablations and diagnostic analyses, show that DeLang-SR provides an effective and interpretable one-step route to super-resolution in the dark. Code and pretrained models are available at https://github.com/moriyaya/DeLang-SR.
BibTeX
@misc{gao2026decoupling,
  author = {Jiaxin Gao and Ziyu Yue and Yaohua Liu and Danchen Cui and Zhihui Zhao and Zhixun Su},
  title = {{Decoupling Direction and Magnitude: Language-Steered Flow Matching for Super-Resolution in the Dark}},
  year = {2026},
  eprint = {2611.10485},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.10485},
}
Figure