Arbitrary-Scale Super-Resolution via Implicit Neural Representations

This direction is merged into another direction: arbitrary-scale super-resolution. Its last version stays readable and citable here.

Version 1 of 1146 papers164 conceptsfrozen 2026-10-04

Traditional image super-resolution (SR) models are "stiff." As noted by Brian Bernhard Moser in Hitchhiker's Guide to Super-Resolution, most architectures are designed for fixed integer upscaling factors like $\times2$ or $\times4$. If you want to zoom in by $\times2.37$, these models typically fail, requiring either a complete retraining or sub-optimal post-processing like bicubic interpolation.

Arbitrary-Scale Super-Resolution (ASSR) breaks this "integer barrier." Instead of treating an image as a discrete grid of pixels, ASSR treats it as a continuous function. This allows a single model to "query" the color of any point at any coordinate, enabling infinite digital zoom and flexible display adaptation.

From Discrete Grids to Continuous Functions

The core intuition behind ASSR is the shift toward Implicit Neural Representations (INR). In a standard model, the output is a tensor of a fixed size. In an INR-based model, the image is represented as a function $f(x, y, \theta)$, where $(x, y)$ are coordinates and $\theta$ are latent features extracted from the low-resolution input.

Zeyuan Chen and Yinbo Chen pioneered this in VideoINR, demonstrating that by learning a continuous representation, a model can perform space-time super-resolution at any resolution or frame rate. This means the model doesn't just guess the next pixel; it learns the underlying signal of the scene.

The Meta-Upscaling Mechanism

Before fully continuous functions became standard, Xuecai Hu introduced Meta-SR, which used a Meta-Upscale Module.

Instead of using fixed convolutional filters, Meta-SR uses a small neural network to dynamically predict the weights of the filters based on the desired scale factor and the relative position of the target pixel. This was the first major step toward scale-agnosticism, proving that a single model could handle a continuous range of magnification factors without losing accuracy compared to specialized fixed-scale models.

Solving the "Grid Artifact" Problem

Early implicit representations often suffered from structural distortions or "checkerboard" artifacts. Xingqian Xu and Zhangyang Wang addressed this in UltraSR by introducing periodic spatial encoding.

By embedding raw coordinates into a high-dimensional space using sine and cosine functions (similar to the positional encodings in Transformers), the model gains a better "sense of place." This allows the underlying MLP to reconstruct high-frequency details more sharply, eliminating the jagged edges common in simpler coordinate-based methods.

Scaling to New Architectures and Domains

The field is rapidly evolving beyond simple MLPs:

  • State Space Models: Peizhe Xia introduced S3Mamba, which uses scale-aware discretization to achieve arbitrary-scale reconstruction with linear computational complexity, making it much faster than Transformer-based approaches.
  • Neural Operators: Min Wei proposed the Super-Resolution Neural Operator (SRNO), which treats SR as a mapping between continuous function spaces rather than pixel grids, using Galerkin-type attention to capture global structures.
  • Diffusion Models: Ruibin Li showed in Diff-SR that pre-trained diffusion models can be "dissected" to perform arbitrary-scale SR without any additional training, simply by optimizing the noise injection process.

Why It Matters: Real-World Flexibility

The shift to arbitrary scales is particularly critical in specialized fields. In medical imaging, Jin Zhu developed MIASSR to allow clinicians to zoom into MRI scans at any magnification. Similarly, Linhao Qu created ISTE for histopathology, enabling pathologists to explore tissue samples at non-integer magnification levels that match their specific diagnostic needs.

By moving from "upscaling pixels" to "reconstructing signals," ASSR provides a unified, efficient, and mathematically elegant solution to the diverse resolution requirements of modern displays and sensors.

Papers in this version

Showing 60 of 146 papers.

History & citationVersion 1 · 2026-10-04

Merged into another direction · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_arbitrary_scale_super_resolution_via_imp_f2ea86f9,
  title = {Arbitrary-Scale Super-Resolution via Implicit Neural Representations},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/arbitrary-scale-super-resolution-via-implicit-neural-representations/rdr_f2ea86f9056640aa9901910a50afc497},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 1, frozen text):

@misc{lacuna_arbitrary_scale_super_resolution_via_imp_f2ea86f9_v1,
  title = {Arbitrary-Scale Super-Resolution via Implicit Neural Representations},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/arbitrary-scale-super-resolution-via-implicit-neural-representations/rdr_f2ea86f9056640aa9901910a50afc497/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}