Progressive Resolution Curricula for Efficient Vision Training

This direction is split into other directions: progressive resolution training, progressive resolution scaling. Its last version stays readable and citable here.

Version 1 of 1350 papers438 conceptsfrozen 2026-10-04

Training modern vision models is a battle against the quadratic cost of pixels. As we move from standard $224 \times 224$ images to high-resolution $1024 \times 1024$ inputs, the computational requirements don't just grow—they explode. However, a recurring insight across diverse architectures suggests that we don't need high resolution for the entire training process. By treating image resolution as a curriculum—starting with coarse, low-resolution inputs and progressively increasing to fine-grained, high-resolution data—researchers are achieving state-of-the-art performance with a fraction of the traditional compute cost.

The Coarse to Fine Intuition

The fundamental reason progressive resolution works is that neural networks learn visual concepts in a hierarchical fashion. In the early stages of training, a model is primarily learning "what" is in an image: global structures, large-scale shapes, and basic semantic compositions. These features are perfectly visible even in heavily downsampled images.

As Tero Karras and colleagues demonstrated in the seminal Progressive Growing of GANs for Improved Quality, Stability, and Variation, starting with $4 \times 4$ images allows a generator to stabilize its global structure before it ever has to worry about the texture of a single hair. This "coarse-to-fine" strategy prevents the model from being overwhelmed by high-frequency noise early on, leading to more stable convergence and a significant reduction in total training time.

The Efficiency of the Inverse Scaling Law

In the context of foundation models like CLIP, this efficiency becomes even more dramatic. Xianhang Li and Cihang Xie identified what they call An Inverse Scaling Law for CLIP Training. They discovered that larger encoders actually require fewer visual tokens to learn effectively. By pre-training on low-resolution inputs and concluding with a brief high-resolution fine-tuning phase, their CLIPA framework trained models up to 33x faster than standard methods.

Similarly, Runze Li showed in RECLIP: Resource-efficient CLIP by Training with Small Images that training on tiny $64 \times 64$ images for the majority of the schedule captures nearly all the necessary semantic concepts. The final high-resolution stage acts as a "refinement" phase, where the model learns to map its established concepts to fine-grained spatial details.

Implementation Strategies Across Modalities

This curriculum approach has been successfully adapted across the entire spectrum of computer vision:

Why It Works: The Gradient Noise Perspective

From an optimization standpoint, progressive resolution training functions as a form of adaptive batching. In the early stages of training, gradients are often noisy as the model searches for the general direction of the loss landscape. Using low-resolution images allows for much larger batch sizes and faster iterations, effectively "averaging out" this noise at a lower cost.

As training progresses and the model nears convergence, the gradients become more precise. This is the optimal time to introduce high-resolution data, as the model is now stable enough to benefit from the subtle, fine-grained signals that high-resolution pixels provide. By aligning the complexity of the input with the maturity of the model, progressive resolution curricula ensure that every FLOP is spent where it provides the most utility.

Papers in this version

Showing 60 of 350 papers.

History & citationVersion 1 · 2026-10-04

Split into other directions · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_progressive_resolution_curricula_for_eff_f33b4a90,
  title = {Progressive Resolution Curricula for Efficient Vision Training},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/progressive-resolution-curricula-for-efficient-vision-training/rdr_f33b4a9080764a958c43c49b825947dd},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_progressive_resolution_curricula_for_eff_f33b4a90_v1,
  title = {Progressive Resolution Curricula for Efficient Vision Training},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/progressive-resolution-curricula-for-efficient-vision-training/rdr_f33b4a9080764a958c43c49b825947dd/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}